2026-02-13T03:37:26.855 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T03:37:26.872 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T03:37:26.956 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108 branch: wip-pdonnell-testing-20260210.171210 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '48108' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - disabled max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - slow metadata IO - SLOW_OPS - slow request sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: dry_run: true install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7166 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 604/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP4XoF/AD5TeWcUNBL0hQC782bcALMZLtSqN0Cqt+6qGviAWc3xf0xpUz0BDJi99lIQJTkKO3TBCXGoVA/Rh4wg= trial127.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBs1aGs0+citlLq2HnmJgFo/XBdhjjYZPWd+W6Ht3soYehkiQta7acUM+PrqWJR0HwdatL0COr3xHgXy6FR4G9s= trial177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMSmgvNZgvv3iRV5+zZr7gcLydue0wBYllrAtGyceKkgGCc2UHFqW9SofDSpF8Fz2a+jBFay70B9i2/pwp2w36E= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-3 teuthology_sha1: a2c505dae37458c5537fa44f1320bd04eef25bb1 timestamp: 2026-02-13_01:53:26 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T03:37:26.956 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa; will attempt to use it 2026-02-13T03:37:26.956 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks 2026-02-13T03:37:26.956 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T03:37:26.958 INFO:teuthology.task.internal:Checking packages... 2026-02-13T03:37:26.958 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-13T03:37:26.958 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T03:37:26.958 INFO:teuthology.packaging:ref: None 2026-02-13T03:37:26.958 INFO:teuthology.packaging:tag: None 2026-02-13T03:37:26.958 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-13T03:37:26.958 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:37:26.958 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-13T03:37:27.077 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-13T03:37:27.077 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T03:37:27.089 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T03:37:27.089 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T03:37:27.105 INFO:teuthology.task.internal:Saving configuration 2026-02-13T03:37:27.123 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T03:37:27.136 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T03:37:27.213 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial070.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 03:34:09.516960', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP4XoF/AD5TeWcUNBL0hQC782bcALMZLtSqN0Cqt+6qGviAWc3xf0xpUz0BDJi99lIQJTkKO3TBCXGoVA/Rh4wg='} 2026-02-13T03:37:27.269 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial127.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 03:34:09.518012', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBs1aGs0+citlLq2HnmJgFo/XBdhjjYZPWd+W6Ht3soYehkiQta7acUM+PrqWJR0HwdatL0COr3xHgXy6FR4G9s='} 2026-02-13T03:37:27.325 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial177.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 03:34:09.517645', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMSmgvNZgvv3iRV5+zZr7gcLydue0wBYllrAtGyceKkgGCc2UHFqW9SofDSpF8Fz2a+jBFay70B9i2/pwp2w36E='} 2026-02-13T03:37:27.326 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T03:37:27.338 INFO:teuthology.task.internal:roles: ubuntu@trial070.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-13T03:37:27.338 INFO:teuthology.task.internal:roles: ubuntu@trial127.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-13T03:37:27.338 INFO:teuthology.task.internal:roles: ubuntu@trial177.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-13T03:37:27.338 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T03:37:27.524 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x741d2b6d27a0>, signals=[15]) 2026-02-13T03:37:27.524 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T03:37:27.536 INFO:teuthology.task.internal:Opening connections... 2026-02-13T03:37:27.536 DEBUG:teuthology.task.internal:connecting to ubuntu@trial070.front.sepia.ceph.com 2026-02-13T03:37:27.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:37:27.595 DEBUG:teuthology.task.internal:connecting to ubuntu@trial127.front.sepia.ceph.com 2026-02-13T03:37:27.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:37:27.658 DEBUG:teuthology.task.internal:connecting to ubuntu@trial177.front.sepia.ceph.com 2026-02-13T03:37:27.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:37:27.717 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T03:37:27.730 DEBUG:teuthology.orchestra.run.trial070:> uname -m 2026-02-13T03:37:27.745 INFO:teuthology.orchestra.run.trial070.stdout:x86_64 2026-02-13T03:37:27.745 DEBUG:teuthology.orchestra.run.trial070:> cat /etc/os-release 2026-02-13T03:37:27.800 INFO:teuthology.orchestra.run.trial070.stdout:NAME="CentOS Stream" 2026-02-13T03:37:27.800 INFO:teuthology.orchestra.run.trial070.stdout:VERSION="9" 2026-02-13T03:37:27.800 INFO:teuthology.orchestra.run.trial070.stdout:ID="centos" 2026-02-13T03:37:27.800 INFO:teuthology.orchestra.run.trial070.stdout:ID_LIKE="rhel fedora" 2026-02-13T03:37:27.800 INFO:teuthology.orchestra.run.trial070.stdout:VERSION_ID="9" 2026-02-13T03:37:27.800 INFO:teuthology.orchestra.run.trial070.stdout:PLATFORM_ID="platform:el9" 2026-02-13T03:37:27.800 INFO:teuthology.orchestra.run.trial070.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T03:37:27.801 INFO:teuthology.orchestra.run.trial070.stdout:ANSI_COLOR="0;31" 2026-02-13T03:37:27.801 INFO:teuthology.orchestra.run.trial070.stdout:LOGO="fedora-logo-icon" 2026-02-13T03:37:27.801 INFO:teuthology.orchestra.run.trial070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T03:37:27.801 INFO:teuthology.orchestra.run.trial070.stdout:HOME_URL="https://centos.org/" 2026-02-13T03:37:27.801 INFO:teuthology.orchestra.run.trial070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T03:37:27.801 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T03:37:27.801 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T03:37:27.801 INFO:teuthology.lock.ops:Updating trial070.front.sepia.ceph.com on lock server 2026-02-13T03:37:27.876 DEBUG:teuthology.orchestra.run.trial127:> uname -m 2026-02-13T03:37:27.891 INFO:teuthology.orchestra.run.trial127.stdout:x86_64 2026-02-13T03:37:27.891 DEBUG:teuthology.orchestra.run.trial127:> cat /etc/os-release 2026-02-13T03:37:27.946 INFO:teuthology.orchestra.run.trial127.stdout:NAME="CentOS Stream" 2026-02-13T03:37:27.946 INFO:teuthology.orchestra.run.trial127.stdout:VERSION="9" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:ID="centos" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:ID_LIKE="rhel fedora" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:VERSION_ID="9" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:PLATFORM_ID="platform:el9" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:ANSI_COLOR="0;31" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:LOGO="fedora-logo-icon" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:HOME_URL="https://centos.org/" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T03:37:27.947 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T03:37:27.947 INFO:teuthology.lock.ops:Updating trial127.front.sepia.ceph.com on lock server 2026-02-13T03:37:28.028 DEBUG:teuthology.orchestra.run.trial177:> uname -m 2026-02-13T03:37:28.044 INFO:teuthology.orchestra.run.trial177.stdout:x86_64 2026-02-13T03:37:28.044 DEBUG:teuthology.orchestra.run.trial177:> cat /etc/os-release 2026-02-13T03:37:28.100 INFO:teuthology.orchestra.run.trial177.stdout:NAME="CentOS Stream" 2026-02-13T03:37:28.100 INFO:teuthology.orchestra.run.trial177.stdout:VERSION="9" 2026-02-13T03:37:28.100 INFO:teuthology.orchestra.run.trial177.stdout:ID="centos" 2026-02-13T03:37:28.100 INFO:teuthology.orchestra.run.trial177.stdout:ID_LIKE="rhel fedora" 2026-02-13T03:37:28.100 INFO:teuthology.orchestra.run.trial177.stdout:VERSION_ID="9" 2026-02-13T03:37:28.100 INFO:teuthology.orchestra.run.trial177.stdout:PLATFORM_ID="platform:el9" 2026-02-13T03:37:28.100 INFO:teuthology.orchestra.run.trial177.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T03:37:28.100 INFO:teuthology.orchestra.run.trial177.stdout:ANSI_COLOR="0;31" 2026-02-13T03:37:28.101 INFO:teuthology.orchestra.run.trial177.stdout:LOGO="fedora-logo-icon" 2026-02-13T03:37:28.101 INFO:teuthology.orchestra.run.trial177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T03:37:28.101 INFO:teuthology.orchestra.run.trial177.stdout:HOME_URL="https://centos.org/" 2026-02-13T03:37:28.101 INFO:teuthology.orchestra.run.trial177.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T03:37:28.101 INFO:teuthology.orchestra.run.trial177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T03:37:28.101 INFO:teuthology.orchestra.run.trial177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T03:37:28.101 INFO:teuthology.lock.ops:Updating trial177.front.sepia.ceph.com on lock server 2026-02-13T03:37:28.186 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T03:37:28.200 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T03:37:28.212 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T03:37:28.213 DEBUG:teuthology.orchestra.run.trial070:> test '!' -e /home/ubuntu/cephtest 2026-02-13T03:37:28.214 DEBUG:teuthology.orchestra.run.trial127:> test '!' -e /home/ubuntu/cephtest 2026-02-13T03:37:28.216 DEBUG:teuthology.orchestra.run.trial177:> test '!' -e /home/ubuntu/cephtest 2026-02-13T03:37:28.231 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T03:37:28.243 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T03:37:28.243 DEBUG:teuthology.orchestra.run.trial070:> test -z $(ls -A /var/lib/ceph) 2026-02-13T03:37:28.268 DEBUG:teuthology.orchestra.run.trial127:> test -z $(ls -A /var/lib/ceph) 2026-02-13T03:37:28.272 DEBUG:teuthology.orchestra.run.trial177:> test -z $(ls -A /var/lib/ceph) 2026-02-13T03:37:28.289 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T03:37:28.515 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T03:37:28.535 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-13T03:37:28.535 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}, 'mon.c': {'sha1': 'distro'}}, timeout 300 2026-02-13T03:37:28.535 DEBUG:teuthology.orchestra.run.trial070:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T03:37:28.535 DEBUG:teuthology.orchestra.run.trial127:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T03:37:28.535 DEBUG:teuthology.orchestra.run.trial177:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T03:37:28.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:37:28.550 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-13T03:37:28.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:37:28.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:37:28.551 DEBUG:teuthology.orchestra.run.trial177:> uname -r 2026-02-13T03:37:28.551 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-13T03:37:28.605 INFO:teuthology.orchestra.run.trial127.stdout:5.14.0-645.el9.x86_64 2026-02-13T03:37:28.606 INFO:teuthology.task.kernel:Running kernel on trial127: 5.14.0-645.el9.x86_64 2026-02-13T03:37:28.606 DEBUG:teuthology.orchestra.run.trial127:> sudo yum install -y kernel 2026-02-13T03:37:28.607 INFO:teuthology.orchestra.run.trial177.stdout:5.14.0-645.el9.x86_64 2026-02-13T03:37:28.607 INFO:teuthology.orchestra.run.trial070.stdout:5.14.0-645.el9.x86_64 2026-02-13T03:37:28.607 INFO:teuthology.task.kernel:Running kernel on trial177: 5.14.0-645.el9.x86_64 2026-02-13T03:37:28.607 DEBUG:teuthology.orchestra.run.trial177:> sudo yum install -y kernel 2026-02-13T03:37:28.607 INFO:teuthology.task.kernel:Running kernel on trial070: 5.14.0-645.el9.x86_64 2026-02-13T03:37:28.607 DEBUG:teuthology.orchestra.run.trial070:> sudo yum install -y kernel 2026-02-13T03:37:29.324 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - BaseOS 25 MB/s | 8.9 MB 00:00 2026-02-13T03:37:30.364 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.9 MB 00:01 2026-02-13T03:37:30.786 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.9 MB 00:01 2026-02-13T03:37:32.645 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 27 MB 00:02 2026-02-13T03:37:33.442 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T03:37:34.767 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 27 MB 00:03 2026-02-13T03:37:36.442 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 7.8 MB 00:01 2026-02-13T03:37:37.450 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 20 kB 00:00 2026-02-13T03:37:37.728 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 7.8 MB 00:01 2026-02-13T03:37:38.442 INFO:teuthology.orchestra.run.trial070.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-13T03:37:38.641 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 20 kB 00:00 2026-02-13T03:37:39.062 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 7.8 MB 00:01 2026-02-13T03:37:39.558 INFO:teuthology.orchestra.run.trial177.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2026-02-13T03:37:40.126 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 20 kB 00:00 2026-02-13T03:37:40.642 INFO:teuthology.orchestra.run.trial127.stdout:Extra Packages for Enterprise Linux 46 MB/s | 20 MB 00:00 2026-02-13T03:37:41.631 INFO:teuthology.orchestra.run.trial070.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-13T03:37:42.688 INFO:teuthology.orchestra.run.trial070.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T03:37:42.708 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-13T03:37:42.709 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-13T03:37:42.709 INFO:teuthology.orchestra.run.trial070.stdout: Package Architecture Version Repository Size 2026-02-13T03:37:42.709 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-13T03:37:42.709 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-13T03:37:42.709 INFO:teuthology.orchestra.run.trial070.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout:Install 4 Packages 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 88 M 2026-02-13T03:37:42.710 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 135 M 2026-02-13T03:37:42.711 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-13T03:37:42.731 INFO:teuthology.orchestra.run.trial177.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-13T03:37:43.795 INFO:teuthology.orchestra.run.trial177.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T03:37:43.815 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-13T03:37:43.816 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-13T03:37:43.816 INFO:teuthology.orchestra.run.trial177.stdout: Package Architecture Version Repository Size 2026-02-13T03:37:43.816 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-13T03:37:43.816 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-13T03:37:43.816 INFO:teuthology.orchestra.run.trial177.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T03:37:43.816 INFO:teuthology.orchestra.run.trial177.stdout:Installing dependencies: 2026-02-13T03:37:43.816 INFO:teuthology.orchestra.run.trial177.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T03:37:43.816 INFO:teuthology.orchestra.run.trial177.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T03:37:43.816 INFO:teuthology.orchestra.run.trial177.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T03:37:43.817 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:37:43.817 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-13T03:37:43.817 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-13T03:37:43.817 INFO:teuthology.orchestra.run.trial177.stdout:Install 4 Packages 2026-02-13T03:37:43.817 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:37:43.817 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 88 M 2026-02-13T03:37:43.817 INFO:teuthology.orchestra.run.trial177.stdout:Installed size: 135 M 2026-02-13T03:37:43.817 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-13T03:37:43.892 INFO:teuthology.orchestra.run.trial127.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-13T03:37:43.911 INFO:teuthology.orchestra.run.trial070.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 861 kB/s | 768 kB 00:00 2026-02-13T03:37:44.005 INFO:teuthology.orchestra.run.trial177.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 5.7 MB/s | 768 kB 00:00 2026-02-13T03:37:44.325 INFO:teuthology.orchestra.run.trial177.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 38 MB/s | 17 MB 00:00 2026-02-13T03:37:44.382 INFO:teuthology.orchestra.run.trial070.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 13 MB/s | 17 MB 00:01 2026-02-13T03:37:44.424 INFO:teuthology.orchestra.run.trial177.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 73 MB/s | 31 MB 00:00 2026-02-13T03:37:44.567 INFO:teuthology.orchestra.run.trial177.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 57 MB/s | 40 MB 00:00 2026-02-13T03:37:44.567 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:37:44.567 INFO:teuthology.orchestra.run.trial177.stdout:Total 117 MB/s | 88 MB 00:00 2026-02-13T03:37:44.758 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-13T03:37:44.954 INFO:teuthology.orchestra.run.trial127.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T03:37:44.962 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-13T03:37:44.962 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-13T03:37:44.974 INFO:teuthology.orchestra.run.trial127.stdout:Dependencies resolved. 2026-02-13T03:37:44.975 INFO:teuthology.orchestra.run.trial127.stdout:================================================================================ 2026-02-13T03:37:44.975 INFO:teuthology.orchestra.run.trial127.stdout: Package Architecture Version Repository Size 2026-02-13T03:37:44.975 INFO:teuthology.orchestra.run.trial127.stdout:================================================================================ 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout:Installing: 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout:Installing dependencies: 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout:Transaction Summary 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout:================================================================================ 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout:Install 4 Packages 2026-02-13T03:37:44.976 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:37:44.977 INFO:teuthology.orchestra.run.trial127.stdout:Total download size: 88 M 2026-02-13T03:37:44.977 INFO:teuthology.orchestra.run.trial127.stdout:Installed size: 135 M 2026-02-13T03:37:44.977 INFO:teuthology.orchestra.run.trial127.stdout:Downloading Packages: 2026-02-13T03:37:44.993 INFO:teuthology.orchestra.run.trial070.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 20 MB/s | 40 MB 00:01 2026-02-13T03:37:45.097 INFO:teuthology.orchestra.run.trial127.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 13 MB/s | 768 kB 00:00 2026-02-13T03:37:45.273 INFO:teuthology.orchestra.run.trial127.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 72 MB/s | 17 MB 00:00 2026-02-13T03:37:45.307 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-13T03:37:45.308 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-13T03:37:45.577 INFO:teuthology.orchestra.run.trial127.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 74 MB/s | 40 MB 00:00 2026-02-13T03:37:45.622 INFO:teuthology.orchestra.run.trial070.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 18 MB/s | 31 MB 00:01 2026-02-13T03:37:45.622 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:37:45.622 INFO:teuthology.orchestra.run.trial070.stdout:Total 30 MB/s | 88 MB 00:02 2026-02-13T03:37:45.810 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-13T03:37:45.921 INFO:teuthology.orchestra.run.trial127.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 37 MB/s | 31 MB 00:00 2026-02-13T03:37:45.921 INFO:teuthology.orchestra.run.trial127.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:37:45.922 INFO:teuthology.orchestra.run.trial127.stdout:Total 93 MB/s | 88 MB 00:00 2026-02-13T03:37:46.012 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-13T03:37:46.012 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-13T03:37:46.115 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction check 2026-02-13T03:37:46.322 INFO:teuthology.orchestra.run.trial127.stdout:Transaction check succeeded. 2026-02-13T03:37:46.322 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction test 2026-02-13T03:37:46.357 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-13T03:37:46.357 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-13T03:37:46.399 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-13T03:37:46.668 INFO:teuthology.orchestra.run.trial127.stdout:Transaction test succeeded. 2026-02-13T03:37:46.668 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction 2026-02-13T03:37:46.684 INFO:teuthology.orchestra.run.trial177.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:37:46.703 INFO:teuthology.orchestra.run.trial177.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:37:47.452 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-13T03:37:47.748 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:37:47.765 INFO:teuthology.orchestra.run.trial127.stdout: Preparing : 1/1 2026-02-13T03:37:47.767 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:37:48.052 INFO:teuthology.orchestra.run.trial127.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:37:48.071 INFO:teuthology.orchestra.run.trial127.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:37:48.467 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:37:48.496 INFO:teuthology.orchestra.run.trial177.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:37:49.524 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:37:49.552 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:37:49.841 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:37:49.869 INFO:teuthology.orchestra.run.trial127.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:37:51.706 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:37:51.712 INFO:teuthology.orchestra.run.trial177.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:37:52.584 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:37:52.591 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:37:52.894 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:37:52.900 INFO:teuthology.orchestra.run.trial127.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:37:54.750 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:37:55.813 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:37:55.931 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:25.224 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:25.245 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:25.310 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:25.310 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:38:25.310 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:38:25.310 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:38:25.363 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:25.363 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:38:25.363 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-13T03:38:25.363 INFO:teuthology.orchestra.run.trial177.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T03:38:25.363 INFO:teuthology.orchestra.run.trial177.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T03:38:25.363 INFO:teuthology.orchestra.run.trial177.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T03:38:25.363 INFO:teuthology.orchestra.run.trial177.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T03:38:25.363 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:38:25.363 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-13T03:38:25.422 DEBUG:teuthology.orchestra.run.trial177:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:38:25.447 INFO:teuthology.orchestra.run.trial177.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:38:25.448 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:38:25.448 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T03:38:25.448 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T03:38:25.448 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T03:38:25.449 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-13T03:38:25.449 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial177.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T03:38:25.449 DEBUG:teuthology.orchestra.run.trial177:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:38:25.511 INFO:teuthology.orchestra.run.trial177.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:38:25.512 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:38:25.512 DEBUG:teuthology.orchestra.run.trial177:> sudo rpm -qi grub2-tools 2026-02-13T03:38:25.580 INFO:teuthology.orchestra.run.trial177.stdout:Name : grub2-tools 2026-02-13T03:38:25.580 INFO:teuthology.orchestra.run.trial177.stdout:Epoch : 1 2026-02-13T03:38:25.580 INFO:teuthology.orchestra.run.trial177.stdout:Version : 2.06 2026-02-13T03:38:25.580 INFO:teuthology.orchestra.run.trial177.stdout:Release : 118.el9 2026-02-13T03:38:25.580 INFO:teuthology.orchestra.run.trial177.stdout:Architecture: x86_64 2026-02-13T03:38:25.580 INFO:teuthology.orchestra.run.trial177.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T03:38:25.580 INFO:teuthology.orchestra.run.trial177.stdout:Group : Unspecified 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:Size : 8393909 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:License : GPLv3+ 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:Packager : builder@centos.org 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:Vendor : CentOS 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:Summary : Support tools for GRUB. 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout:Description : 2026-02-13T03:38:25.581 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:38:25.582 INFO:teuthology.orchestra.run.trial177.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T03:38:25.582 INFO:teuthology.orchestra.run.trial177.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T03:38:25.582 INFO:teuthology.orchestra.run.trial177.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T03:38:25.582 INFO:teuthology.orchestra.run.trial177.stdout:hardware devices. 2026-02-13T03:38:25.582 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:38:25.582 INFO:teuthology.orchestra.run.trial177.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T03:38:25.583 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T03:38:25.583 INFO:teuthology.task.kernel:Updating grub on trial177 to boot 5.14.0-677.el9.x86_64 2026-02-13T03:38:25.583 DEBUG:teuthology.orchestra.run.trial177:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T03:38:25.646 INFO:teuthology.orchestra.run.trial177.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T03:38:25.647 DEBUG:teuthology.orchestra.run.trial177:> sudo command -v grubby && echo yes || echo no 2026-02-13T03:38:25.711 INFO:teuthology.orchestra.run.trial177.stdout:/sbin/grubby 2026-02-13T03:38:25.712 INFO:teuthology.orchestra.run.trial177.stdout:yes 2026-02-13T03:38:25.713 DEBUG:teuthology.orchestra.run.trial177:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T03:38:25.777 INFO:teuthology.orchestra.run.trial177.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T03:38:25.778 DEBUG:teuthology.orchestra.run.trial177:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T03:38:25.851 DEBUG:teuthology.orchestra.run.trial177:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T03:38:26.058 INFO:teuthology.orchestra.run.trial177.stderr:Generating grub configuration file ... 2026-02-13T03:38:26.120 INFO:teuthology.orchestra.run.trial177.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.126 INFO:teuthology.orchestra.run.trial177.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T03:38:26.256 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:26.278 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:26.312 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:26.334 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:26.376 INFO:teuthology.orchestra.run.trial177.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T03:38:26.383 INFO:teuthology.orchestra.run.trial177.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T03:38:26.397 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:26.398 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:38:26.398 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:38:26.398 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:38:26.415 INFO:teuthology.orchestra.run.trial177.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T03:38:26.421 INFO:teuthology.orchestra.run.trial177.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T03:38:26.445 INFO:teuthology.orchestra.run.trial177.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T03:38:26.450 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:26.450 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:38:26.451 INFO:teuthology.orchestra.run.trial127.stdout:Installed: 2026-02-13T03:38:26.451 INFO:teuthology.orchestra.run.trial127.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.451 INFO:teuthology.orchestra.run.trial127.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.451 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.451 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.451 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:38:26.451 INFO:teuthology.orchestra.run.trial127.stdout:Complete! 2026-02-13T03:38:26.452 INFO:teuthology.orchestra.run.trial177.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T03:38:26.453 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:26.453 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T03:38:26.453 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T03:38:26.453 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T03:38:26.505 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T03:38:26.505 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:38:26.505 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-13T03:38:26.505 INFO:teuthology.orchestra.run.trial070.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.505 INFO:teuthology.orchestra.run.trial070.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.506 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.506 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.506 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:38:26.506 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-13T03:38:26.512 DEBUG:teuthology.orchestra.run.trial127:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:38:26.532 INFO:teuthology.orchestra.run.trial177.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T03:38:26.538 INFO:teuthology.orchestra.run.trial127.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.539 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:38:26.539 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T03:38:26.539 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T03:38:26.540 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T03:38:26.540 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-13T03:38:26.540 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial127.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T03:38:26.540 DEBUG:teuthology.orchestra.run.trial127:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:38:26.541 INFO:teuthology.orchestra.run.trial177.stderr:done 2026-02-13T03:38:26.542 DEBUG:teuthology.orchestra.run.trial177:> test -d /sys/firmware/efi 2026-02-13T03:38:26.558 DEBUG:teuthology.orchestra.run.trial177:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T03:38:26.563 DEBUG:teuthology.orchestra.run.trial070:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:38:26.588 INFO:teuthology.orchestra.run.trial070.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.589 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:38:26.589 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T03:38:26.590 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T03:38:26.590 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T03:38:26.590 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T03:38:26.590 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial070.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T03:38:26.590 DEBUG:teuthology.orchestra.run.trial070:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T03:38:26.601 INFO:teuthology.orchestra.run.trial127.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.602 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:38:26.603 DEBUG:teuthology.orchestra.run.trial127:> sudo rpm -qi grub2-tools 2026-02-13T03:38:26.623 INFO:teuthology.orchestra.run.trial177.stdout:/boot/efi/EFI/BOOT 2026-02-13T03:38:26.623 INFO:teuthology.orchestra.run.trial177.stdout:/boot/efi/EFI/centos 2026-02-13T03:38:26.625 DEBUG:teuthology.orchestra.run.trial177:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T03:38:26.652 INFO:teuthology.orchestra.run.trial070.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.654 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T03:38:26.654 DEBUG:teuthology.orchestra.run.trial070:> sudo rpm -qi grub2-tools 2026-02-13T03:38:26.672 INFO:teuthology.orchestra.run.trial127.stdout:Name : grub2-tools 2026-02-13T03:38:26.672 INFO:teuthology.orchestra.run.trial127.stdout:Epoch : 1 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Version : 2.06 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Release : 118.el9 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Architecture: x86_64 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Group : Unspecified 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Size : 8393909 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:License : GPLv3+ 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T03:38:26.673 INFO:teuthology.orchestra.run.trial127.stdout:Packager : builder@centos.org 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout:Vendor : CentOS 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout:Summary : Support tools for GRUB. 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout:Description : 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout:hardware devices. 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:38:26.674 INFO:teuthology.orchestra.run.trial127.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T03:38:26.675 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T03:38:26.676 INFO:teuthology.task.kernel:Updating grub on trial127 to boot 5.14.0-677.el9.x86_64 2026-02-13T03:38:26.676 DEBUG:teuthology.orchestra.run.trial127:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T03:38:26.690 INFO:teuthology.orchestra.run.trial177.stdout:no 2026-02-13T03:38:26.691 DEBUG:teuthology.orchestra.run.trial177:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T03:38:26.723 INFO:teuthology.orchestra.run.trial070.stdout:Name : grub2-tools 2026-02-13T03:38:26.723 INFO:teuthology.orchestra.run.trial070.stdout:Epoch : 1 2026-02-13T03:38:26.723 INFO:teuthology.orchestra.run.trial070.stdout:Version : 2.06 2026-02-13T03:38:26.723 INFO:teuthology.orchestra.run.trial070.stdout:Release : 118.el9 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Architecture: x86_64 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Group : Unspecified 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Size : 8393909 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:License : GPLv3+ 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Packager : builder@centos.org 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:Vendor : CentOS 2026-02-13T03:38:26.724 INFO:teuthology.orchestra.run.trial070.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T03:38:26.725 INFO:teuthology.orchestra.run.trial070.stdout:Summary : Support tools for GRUB. 2026-02-13T03:38:26.725 INFO:teuthology.orchestra.run.trial070.stdout:Description : 2026-02-13T03:38:26.725 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:38:26.725 INFO:teuthology.orchestra.run.trial070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T03:38:26.725 INFO:teuthology.orchestra.run.trial070.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T03:38:26.725 INFO:teuthology.orchestra.run.trial070.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T03:38:26.725 INFO:teuthology.orchestra.run.trial070.stdout:hardware devices. 2026-02-13T03:38:26.725 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:38:26.725 INFO:teuthology.orchestra.run.trial070.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T03:38:26.726 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T03:38:26.726 INFO:teuthology.task.kernel:Updating grub on trial070 to boot 5.14.0-677.el9.x86_64 2026-02-13T03:38:26.727 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T03:38:26.738 INFO:teuthology.orchestra.run.trial127.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T03:38:26.739 DEBUG:teuthology.orchestra.run.trial127:> sudo command -v grubby && echo yes || echo no 2026-02-13T03:38:26.755 INFO:teuthology.orchestra.run.trial177.stdout:yes 2026-02-13T03:38:26.755 DEBUG:teuthology.orchestra.run.trial177:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T03:38:26.790 INFO:teuthology.orchestra.run.trial070.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T03:38:26.792 DEBUG:teuthology.orchestra.run.trial070:> sudo command -v grubby && echo yes || echo no 2026-02-13T03:38:26.804 INFO:teuthology.orchestra.run.trial127.stdout:/sbin/grubby 2026-02-13T03:38:26.805 INFO:teuthology.orchestra.run.trial127.stdout:yes 2026-02-13T03:38:26.806 DEBUG:teuthology.orchestra.run.trial127:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T03:38:26.819 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial177 2026-02-13T03:38:26.819 DEBUG:teuthology.orchestra.run.trial177:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T03:38:26.857 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/grubby 2026-02-13T03:38:26.858 INFO:teuthology.orchestra.run.trial070.stdout:yes 2026-02-13T03:38:26.858 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T03:38:26.869 INFO:teuthology.orchestra.run.trial127.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T03:38:26.870 DEBUG:teuthology.orchestra.run.trial127:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.923 INFO:teuthology.orchestra.run.trial070.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T03:38:26.924 DEBUG:teuthology.orchestra.run.trial070:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T03:38:26.942 DEBUG:teuthology.orchestra.run.trial127:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T03:38:26.996 DEBUG:teuthology.orchestra.run.trial070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T03:38:27.151 INFO:teuthology.orchestra.run.trial127.stderr:Generating grub configuration file ... 2026-02-13T03:38:27.201 INFO:teuthology.orchestra.run.trial070.stderr:Generating grub configuration file ... 2026-02-13T03:38:27.216 INFO:teuthology.orchestra.run.trial127.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T03:38:27.222 INFO:teuthology.orchestra.run.trial127.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T03:38:27.264 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T03:38:27.271 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T03:38:27.476 INFO:teuthology.orchestra.run.trial127.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T03:38:27.482 INFO:teuthology.orchestra.run.trial127.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T03:38:27.514 INFO:teuthology.orchestra.run.trial127.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T03:38:27.521 INFO:teuthology.orchestra.run.trial127.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T03:38:27.521 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T03:38:27.528 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T03:38:27.544 INFO:teuthology.orchestra.run.trial127.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T03:38:27.551 INFO:teuthology.orchestra.run.trial127.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T03:38:27.560 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T03:38:27.567 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T03:38:27.590 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T03:38:27.596 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T03:38:27.635 INFO:teuthology.orchestra.run.trial127.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T03:38:27.643 INFO:teuthology.orchestra.run.trial127.stderr:done 2026-02-13T03:38:27.645 DEBUG:teuthology.orchestra.run.trial127:> test -d /sys/firmware/efi 2026-02-13T03:38:27.660 DEBUG:teuthology.orchestra.run.trial127:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T03:38:27.677 INFO:teuthology.orchestra.run.trial070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T03:38:27.685 INFO:teuthology.orchestra.run.trial070.stderr:done 2026-02-13T03:38:27.687 DEBUG:teuthology.orchestra.run.trial070:> test -d /sys/firmware/efi 2026-02-13T03:38:27.704 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T03:38:27.726 INFO:teuthology.orchestra.run.trial127.stdout:/boot/efi/EFI/BOOT 2026-02-13T03:38:27.726 INFO:teuthology.orchestra.run.trial127.stdout:/boot/efi/EFI/centos 2026-02-13T03:38:27.728 DEBUG:teuthology.orchestra.run.trial127:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T03:38:27.768 INFO:teuthology.orchestra.run.trial070.stdout:/boot/efi/EFI/BOOT 2026-02-13T03:38:27.768 INFO:teuthology.orchestra.run.trial070.stdout:/boot/efi/EFI/centos 2026-02-13T03:38:27.770 DEBUG:teuthology.orchestra.run.trial070:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T03:38:27.794 INFO:teuthology.orchestra.run.trial127.stdout:no 2026-02-13T03:38:27.794 DEBUG:teuthology.orchestra.run.trial127:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T03:38:27.835 INFO:teuthology.orchestra.run.trial070.stdout:no 2026-02-13T03:38:27.835 DEBUG:teuthology.orchestra.run.trial070:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T03:38:27.859 INFO:teuthology.orchestra.run.trial127.stdout:yes 2026-02-13T03:38:27.859 DEBUG:teuthology.orchestra.run.trial127:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T03:38:27.900 INFO:teuthology.orchestra.run.trial070.stdout:yes 2026-02-13T03:38:27.900 DEBUG:teuthology.orchestra.run.trial070:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T03:38:27.925 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial127 2026-02-13T03:38:27.925 DEBUG:teuthology.orchestra.run.trial127:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T03:38:27.965 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial070 2026-02-13T03:38:27.965 DEBUG:teuthology.orchestra.run.trial070:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T03:38:56.861 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-13T03:38:56.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-13T03:38:56.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:38:57.967 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-13T03:38:57.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-13T03:38:57.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:38:58.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T03:38:58.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-13T03:38:58.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:39:11.133 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.177 2026-02-13T03:39:12.221 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.127 2026-02-13T03:39:12.285 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.70 2026-02-13T03:39:20.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-13T03:39:20.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:39:21.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-13T03:39:21.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:39:21.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-13T03:39:21.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:39:56.058 DEBUG:teuthology.orchestra.run.trial177:> true 2026-02-13T03:39:56.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-13T03:39:56.210 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-13T03:39:56.211 DEBUG:teuthology.orchestra.run.trial177:> uname -r 2026-02-13T03:39:56.266 INFO:teuthology.orchestra.run.trial177.stdout:5.14.0-677.el9.x86_64 2026-02-13T03:39:56.267 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T03:39:56.267 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T03:39:56.267 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T03:39:57.132 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-13T03:39:57.136 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-13T03:39:57.268 DEBUG:teuthology.parallel:result is None 2026-02-13T03:39:57.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-13T03:39:57.287 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-13T03:39:57.288 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-13T03:39:57.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-13T03:39:57.289 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-13T03:39:57.289 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-13T03:39:57.343 INFO:teuthology.orchestra.run.trial070.stdout:5.14.0-677.el9.x86_64 2026-02-13T03:39:57.343 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T03:39:57.343 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T03:39:57.343 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T03:39:57.347 INFO:teuthology.orchestra.run.trial127.stdout:5.14.0-677.el9.x86_64 2026-02-13T03:39:57.347 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T03:39:57.347 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T03:39:57.348 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T03:39:58.344 DEBUG:teuthology.parallel:result is None 2026-02-13T03:39:58.348 DEBUG:teuthology.parallel:result is None 2026-02-13T03:39:58.348 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T03:39:58.360 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T03:39:58.360 DEBUG:teuthology.orchestra.run.trial070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T03:39:58.363 DEBUG:teuthology.orchestra.run.trial127:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T03:39:58.366 DEBUG:teuthology.orchestra.run.trial177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T03:39:58.384 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T03:39:58.396 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T03:39:58.410 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T03:39:58.410 DEBUG:teuthology.orchestra.run.trial070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T03:39:58.421 DEBUG:teuthology.orchestra.run.trial127:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T03:39:58.424 DEBUG:teuthology.orchestra.run.trial177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T03:39:58.452 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T03:39:58.463 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T03:39:58.464 DEBUG:teuthology.orchestra.run.trial070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T03:39:58.478 DEBUG:teuthology.orchestra.run.trial127:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T03:39:58.482 DEBUG:teuthology.orchestra.run.trial177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T03:39:58.505 INFO:teuthology.orchestra.run.trial070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:39:58.508 INFO:teuthology.orchestra.run.trial127.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:39:58.510 INFO:teuthology.orchestra.run.trial177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:39:58.514 INFO:teuthology.orchestra.run.trial070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:39:58.517 INFO:teuthology.orchestra.run.trial127.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:39:58.519 INFO:teuthology.orchestra.run.trial177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:39:58.521 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T03:39:58.538 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T03:39:58.538 DEBUG:teuthology.orchestra.run.trial070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T03:39:58.558 DEBUG:teuthology.orchestra.run.trial127:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T03:39:58.561 DEBUG:teuthology.orchestra.run.trial177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T03:39:58.587 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T03:39:58.603 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T03:39:58.604 DEBUG:teuthology.orchestra.run.trial070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T03:39:58.622 DEBUG:teuthology.orchestra.run.trial127:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T03:39:58.625 DEBUG:teuthology.orchestra.run.trial177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T03:39:58.645 DEBUG:teuthology.orchestra.run.trial070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:39:58.793 DEBUG:teuthology.orchestra.run.trial070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:39:58.818 DEBUG:teuthology.orchestra.run.trial070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:39:58.965 DEBUG:teuthology.orchestra.run.trial070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:39:58.989 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:39:58.989 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T03:39:59.054 DEBUG:teuthology.orchestra.run.trial127:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:39:59.170 DEBUG:teuthology.orchestra.run.trial127:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:39:59.195 DEBUG:teuthology.orchestra.run.trial127:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:39:59.346 DEBUG:teuthology.orchestra.run.trial127:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:39:59.372 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:39:59.372 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T03:39:59.436 DEBUG:teuthology.orchestra.run.trial177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:39:59.554 DEBUG:teuthology.orchestra.run.trial177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:39:59.578 DEBUG:teuthology.orchestra.run.trial177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:39:59.721 DEBUG:teuthology.orchestra.run.trial177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:39:59.746 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:39:59.746 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T03:39:59.809 DEBUG:teuthology.orchestra.run.trial070:> sudo service rsyslog restart 2026-02-13T03:39:59.811 DEBUG:teuthology.orchestra.run.trial127:> sudo service rsyslog restart 2026-02-13T03:39:59.814 DEBUG:teuthology.orchestra.run.trial177:> sudo service rsyslog restart 2026-02-13T03:39:59.838 INFO:teuthology.orchestra.run.trial070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:39:59.840 INFO:teuthology.orchestra.run.trial127.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:39:59.876 INFO:teuthology.orchestra.run.trial177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:40:00.401 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T03:40:00.413 INFO:teuthology.task.internal:Starting timer... 2026-02-13T03:40:00.413 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T03:40:00.435 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T03:40:00.452 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-13T03:40:00.453 DEBUG:teuthology.orchestra.run.trial070:> sudo service auditd rotate 2026-02-13T03:40:00.482 INFO:teuthology.orchestra.run.trial070.stdout:Rotating logs: 2026-02-13T03:40:00.484 DEBUG:teuthology.orchestra.run.trial127:> sudo service auditd rotate 2026-02-13T03:40:00.514 INFO:teuthology.orchestra.run.trial127.stdout:Rotating logs: 2026-02-13T03:40:00.516 DEBUG:teuthology.orchestra.run.trial177:> sudo service auditd rotate 2026-02-13T03:40:00.545 INFO:teuthology.orchestra.run.trial177.stdout:Rotating logs: 2026-02-13T03:40:00.547 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T03:40:00.547 DEBUG:teuthology.orchestra.run.trial070:> /usr/sbin/getenforce 2026-02-13T03:40:00.565 INFO:teuthology.orchestra.run.trial070.stdout:Permissive 2026-02-13T03:40:00.565 DEBUG:teuthology.orchestra.run.trial127:> /usr/sbin/getenforce 2026-02-13T03:40:00.582 INFO:teuthology.orchestra.run.trial127.stdout:Permissive 2026-02-13T03:40:00.582 DEBUG:teuthology.orchestra.run.trial177:> /usr/sbin/getenforce 2026-02-13T03:40:00.603 INFO:teuthology.orchestra.run.trial177.stdout:Permissive 2026-02-13T03:40:00.604 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial070.front.sepia.ceph.com': 'permissive', 'ubuntu@trial127.front.sepia.ceph.com': 'permissive', 'ubuntu@trial177.front.sepia.ceph.com': 'permissive'} 2026-02-13T03:40:00.604 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:40:00.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:40:00.632 DEBUG:teuthology.orchestra.run.trial127:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:40:00.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:40:00.658 DEBUG:teuthology.orchestra.run.trial177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:40:00.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:40:00.683 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T03:40:00.683 DEBUG:teuthology.orchestra.run.trial070:> sudo /usr/sbin/setenforce permissive 2026-02-13T03:40:00.707 DEBUG:teuthology.orchestra.run.trial127:> sudo /usr/sbin/setenforce permissive 2026-02-13T03:40:00.730 DEBUG:teuthology.orchestra.run.trial177:> sudo /usr/sbin/setenforce permissive 2026-02-13T03:40:00.753 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T03:40:00.769 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-13T03:40:00.772 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-13T03:40:00.920 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T03:40:00.932 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T03:40:00.934 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial070.front.sepia.ceph.com,trial127.front.sepia.ceph.com,trial177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T03:41:31.212 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial070.front.sepia.ceph.com'), Remote(name='ubuntu@trial127.front.sepia.ceph.com'), Remote(name='ubuntu@trial177.front.sepia.ceph.com')] 2026-02-13T03:41:31.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-13T03:41:31.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:41:31.322 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-13T03:41:31.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-13T03:41:31.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-13T03:41:31.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:41:31.486 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-13T03:41:31.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-13T03:41:31.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-13T03:41:31.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:41:31.658 DEBUG:teuthology.orchestra.run.trial177:> true 2026-02-13T03:41:31.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-13T03:41:31.733 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T03:41:31.749 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T03:41:31.750 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T03:41:31.750 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:41:31.752 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T03:41:31.752 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:41:31.754 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T03:41:31.755 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:41:31.779 INFO:teuthology.orchestra.run.trial070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T03:41:31.779 INFO:teuthology.orchestra.run.trial127.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T03:41:31.790 INFO:teuthology.orchestra.run.trial127.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T03:41:31.791 INFO:teuthology.orchestra.run.trial070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T03:41:31.799 INFO:teuthology.orchestra.run.trial177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T03:41:31.810 INFO:teuthology.orchestra.run.trial127.stderr:sudo: ntpd: command not found 2026-02-13T03:41:31.811 INFO:teuthology.orchestra.run.trial177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T03:41:31.812 INFO:teuthology.orchestra.run.trial070.stderr:sudo: ntpd: command not found 2026-02-13T03:41:31.820 INFO:teuthology.orchestra.run.trial127.stdout:506 Cannot talk to daemon 2026-02-13T03:41:31.822 INFO:teuthology.orchestra.run.trial070.stdout:506 Cannot talk to daemon 2026-02-13T03:41:31.831 INFO:teuthology.orchestra.run.trial127.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T03:41:31.833 INFO:teuthology.orchestra.run.trial177.stderr:sudo: ntpd: command not found 2026-02-13T03:41:31.834 INFO:teuthology.orchestra.run.trial070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T03:41:31.842 INFO:teuthology.orchestra.run.trial127.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T03:41:31.843 INFO:teuthology.orchestra.run.trial177.stdout:506 Cannot talk to daemon 2026-02-13T03:41:31.846 INFO:teuthology.orchestra.run.trial070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T03:41:31.855 INFO:teuthology.orchestra.run.trial177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T03:41:31.867 INFO:teuthology.orchestra.run.trial177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T03:41:31.883 INFO:teuthology.orchestra.run.trial127.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:41:31.884 INFO:teuthology.orchestra.run.trial127.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:41:31.884 INFO:teuthology.orchestra.run.trial127.stdout:=============================================================================== 2026-02-13T03:41:31.888 INFO:teuthology.orchestra.run.trial070.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:41:31.902 INFO:teuthology.orchestra.run.trial070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:41:31.902 INFO:teuthology.orchestra.run.trial070.stdout:=============================================================================== 2026-02-13T03:41:31.902 INFO:teuthology.orchestra.run.trial070.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:41:31.902 INFO:teuthology.orchestra.run.trial070.stdout:^? x.ns.gin.ntt.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:41:31.902 INFO:teuthology.orchestra.run.trial070.stdout:^? ntp1.wiktel.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:41:31.910 INFO:teuthology.orchestra.run.trial177.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:41:31.916 INFO:teuthology.orchestra.run.trial177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:41:31.916 INFO:teuthology.orchestra.run.trial177.stdout:=============================================================================== 2026-02-13T03:41:31.917 INFO:teuthology.orchestra.run.trial177.stdout:^? s2-a.time.mci1.us.rozint> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:41:31.917 INFO:teuthology.orchestra.run.trial177.stdout:^? x.ns.gin.ntt.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:41:31.917 INFO:teuthology.orchestra.run.trial177.stdout:^? ntp1.wiktel.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:41:31.918 INFO:teuthology.run_tasks:Running task pexec... 2026-02-13T03:41:31.935 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-13T03:41:31.936 DEBUG:teuthology.orchestra.run.trial070:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T03:41:31.937 DEBUG:teuthology.orchestra.run.trial127:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T03:41:31.937 DEBUG:teuthology.orchestra.run.trial177:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T03:41:31.940 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial127.front.sepia.ceph.com 2026-02-13T03:41:31.940 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T03:41:31.940 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T03:41:31.946 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial070.front.sepia.ceph.com 2026-02-13T03:41:31.946 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T03:41:31.946 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T03:41:31.960 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial177.front.sepia.ceph.com 2026-02-13T03:41:31.961 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T03:41:31.961 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T03:41:32.111 INFO:teuthology.orchestra.run.trial127.stdout:No match for argument: nvme-cli 2026-02-13T03:41:32.112 INFO:teuthology.orchestra.run.trial127.stderr:No packages marked for removal. 2026-02-13T03:41:32.114 INFO:teuthology.orchestra.run.trial127.stdout:Dependencies resolved. 2026-02-13T03:41:32.114 INFO:teuthology.orchestra.run.trial127.stdout:Nothing to do. 2026-02-13T03:41:32.114 INFO:teuthology.orchestra.run.trial127.stdout:Complete! 2026-02-13T03:41:32.118 INFO:teuthology.orchestra.run.trial070.stdout:No match for argument: nvme-cli 2026-02-13T03:41:32.119 INFO:teuthology.orchestra.run.trial070.stderr:No packages marked for removal. 2026-02-13T03:41:32.121 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-13T03:41:32.121 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-13T03:41:32.121 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-13T03:41:32.133 INFO:teuthology.orchestra.run.trial177.stdout:No match for argument: nvme-cli 2026-02-13T03:41:32.134 INFO:teuthology.orchestra.run.trial177.stderr:No packages marked for removal. 2026-02-13T03:41:32.136 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-13T03:41:32.137 INFO:teuthology.orchestra.run.trial177.stdout:Nothing to do. 2026-02-13T03:41:32.137 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-13T03:41:32.409 INFO:teuthology.orchestra.run.trial127.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Feb 2026 03:40:42 AM UTC. 2026-02-13T03:41:32.421 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Feb 2026 03:40:42 AM UTC. 2026-02-13T03:41:32.429 INFO:teuthology.orchestra.run.trial177.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Feb 2026 03:40:42 AM UTC. 2026-02-13T03:41:32.490 INFO:teuthology.orchestra.run.trial127.stdout:Dependencies resolved. 2026-02-13T03:41:32.491 INFO:teuthology.orchestra.run.trial127.stdout:================================================================================ 2026-02-13T03:41:32.491 INFO:teuthology.orchestra.run.trial127.stdout: Package Architecture Version Repository Size 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout:================================================================================ 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout:Installing: 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout:Upgrading: 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout:Installing dependencies: 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T03:41:32.492 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:41:32.493 INFO:teuthology.orchestra.run.trial127.stdout:Transaction Summary 2026-02-13T03:41:32.493 INFO:teuthology.orchestra.run.trial127.stdout:================================================================================ 2026-02-13T03:41:32.493 INFO:teuthology.orchestra.run.trial127.stdout:Install 6 Packages 2026-02-13T03:41:32.493 INFO:teuthology.orchestra.run.trial127.stdout:Upgrade 1 Package 2026-02-13T03:41:32.493 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:41:32.493 INFO:teuthology.orchestra.run.trial127.stdout:Total download size: 2.4 M 2026-02-13T03:41:32.494 INFO:teuthology.orchestra.run.trial127.stdout:Downloading Packages: 2026-02-13T03:41:32.503 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-13T03:41:32.503 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout: Package Architecture Version Repository Size 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout:Upgrading: 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T03:41:32.504 INFO:teuthology.orchestra.run.trial070.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T03:41:32.505 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:41:32.505 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-13T03:41:32.505 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-13T03:41:32.505 INFO:teuthology.orchestra.run.trial070.stdout:Install 6 Packages 2026-02-13T03:41:32.505 INFO:teuthology.orchestra.run.trial070.stdout:Upgrade 1 Package 2026-02-13T03:41:32.505 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:41:32.505 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 2.4 M 2026-02-13T03:41:32.506 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-13T03:41:32.510 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-13T03:41:32.511 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-13T03:41:32.511 INFO:teuthology.orchestra.run.trial177.stdout: Package Architecture Version Repository Size 2026-02-13T03:41:32.511 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-13T03:41:32.511 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout:Upgrading: 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout:Installing dependencies: 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-13T03:41:32.512 INFO:teuthology.orchestra.run.trial177.stdout:================================================================================ 2026-02-13T03:41:32.513 INFO:teuthology.orchestra.run.trial177.stdout:Install 6 Packages 2026-02-13T03:41:32.513 INFO:teuthology.orchestra.run.trial177.stdout:Upgrade 1 Package 2026-02-13T03:41:32.513 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:41:32.513 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 2.4 M 2026-02-13T03:41:32.513 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-13T03:41:32.905 INFO:teuthology.orchestra.run.trial177.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 2.3 MB/s | 44 kB 00:00 2026-02-13T03:41:32.906 INFO:teuthology.orchestra.run.trial177.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 3.6 MB/s | 72 kB 00:00 2026-02-13T03:41:32.913 INFO:teuthology.orchestra.run.trial177.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 10 MB/s | 84 kB 00:00 2026-02-13T03:41:32.915 INFO:teuthology.orchestra.run.trial177.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 16 MB/s | 150 kB 00:00 2026-02-13T03:41:32.921 INFO:teuthology.orchestra.run.trial177.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 34 MB/s | 1.2 MB 00:00 2026-02-13T03:41:32.921 INFO:teuthology.orchestra.run.trial127.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 1.2 MB/s | 44 kB 00:00 2026-02-13T03:41:32.921 INFO:teuthology.orchestra.run.trial177.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 19 MB/s | 116 kB 00:00 2026-02-13T03:41:32.928 INFO:teuthology.orchestra.run.trial177.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 58 MB/s | 837 kB 00:00 2026-02-13T03:41:32.928 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:41:32.928 INFO:teuthology.orchestra.run.trial177.stdout:Total 5.8 MB/s | 2.4 MB 00:00 2026-02-13T03:41:32.929 INFO:teuthology.orchestra.run.trial127.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 1.6 MB/s | 72 kB 00:00 2026-02-13T03:41:32.938 INFO:teuthology.orchestra.run.trial127.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 4.8 MB/s | 84 kB 00:00 2026-02-13T03:41:32.951 INFO:teuthology.orchestra.run.trial127.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 6.8 MB/s | 150 kB 00:00 2026-02-13T03:41:32.955 INFO:teuthology.orchestra.run.trial127.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 17 MB/s | 1.2 MB 00:00 2026-02-13T03:41:32.962 INFO:teuthology.orchestra.run.trial127.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 10 MB/s | 116 kB 00:00 2026-02-13T03:41:32.970 INFO:teuthology.orchestra.run.trial127.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 26 MB/s | 837 kB 00:00 2026-02-13T03:41:32.970 INFO:teuthology.orchestra.run.trial127.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:41:32.970 INFO:teuthology.orchestra.run.trial127.stdout:Total 5.1 MB/s | 2.4 MB 00:00 2026-02-13T03:41:32.990 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-13T03:41:32.999 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-13T03:41:32.999 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-13T03:41:33.034 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction check 2026-02-13T03:41:33.042 INFO:teuthology.orchestra.run.trial127.stdout:Transaction check succeeded. 2026-02-13T03:41:33.042 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction test 2026-02-13T03:41:33.061 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-13T03:41:33.062 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-13T03:41:33.107 INFO:teuthology.orchestra.run.trial127.stdout:Transaction test succeeded. 2026-02-13T03:41:33.107 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction 2026-02-13T03:41:33.131 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-13T03:41:33.177 INFO:teuthology.orchestra.run.trial127.stdout: Preparing : 1/1 2026-02-13T03:41:33.181 INFO:teuthology.orchestra.run.trial070.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 149 kB/s | 44 kB 00:00 2026-02-13T03:41:33.185 INFO:teuthology.orchestra.run.trial070.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 240 kB/s | 72 kB 00:00 2026-02-13T03:41:33.200 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T03:41:33.207 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T03:41:33.216 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T03:41:33.222 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T03:41:33.228 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T03:41:33.228 INFO:teuthology.orchestra.run.trial177.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:41:33.244 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T03:41:33.251 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T03:41:33.260 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T03:41:33.267 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T03:41:33.272 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T03:41:33.273 INFO:teuthology.orchestra.run.trial127.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:41:33.362 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:41:33.364 INFO:teuthology.orchestra.run.trial177.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:41:33.403 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:41:33.406 INFO:teuthology.orchestra.run.trial127.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:41:33.413 INFO:teuthology.orchestra.run.trial070.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 363 kB/s | 84 kB 00:00 2026-02-13T03:41:33.462 INFO:teuthology.orchestra.run.trial070.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 544 kB/s | 150 kB 00:00 2026-02-13T03:41:33.636 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:41:33.636 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T03:41:33.636 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:41:33.659 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:41:33.677 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:41:33.677 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T03:41:33.677 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:41:33.700 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:41:33.727 INFO:teuthology.orchestra.run.trial070.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 1.4 MB/s | 1.2 MB 00:00 2026-02-13T03:41:33.736 INFO:teuthology.orchestra.run.trial070.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 425 kB/s | 116 kB 00:00 2026-02-13T03:41:33.871 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:41:33.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T03:41:33.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T03:41:33.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T03:41:33.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T03:41:33.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T03:41:33.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T03:41:33.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T03:41:33.912 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:41:33.912 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T03:41:33.912 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T03:41:33.912 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T03:41:33.912 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T03:41:33.912 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T03:41:33.912 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T03:41:33.912 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T03:41:33.924 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:41:33.924 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:41:33.924 INFO:teuthology.orchestra.run.trial177.stdout:Upgraded: 2026-02-13T03:41:33.924 INFO:teuthology.orchestra.run.trial177.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T03:41:33.924 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-13T03:41:33.924 INFO:teuthology.orchestra.run.trial177.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T03:41:33.924 INFO:teuthology.orchestra.run.trial177.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T03:41:33.924 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T03:41:33.925 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:41:33.925 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-13T03:41:33.954 DEBUG:teuthology.parallel:result is None 2026-02-13T03:41:33.960 INFO:teuthology.orchestra.run.trial070.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 1.5 MB/s | 837 kB 00:00 2026-02-13T03:41:33.960 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:41:33.961 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.7 MB/s | 2.4 MB 00:01 2026-02-13T03:41:33.965 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:41:33.965 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:41:33.965 INFO:teuthology.orchestra.run.trial127.stdout:Upgraded: 2026-02-13T03:41:33.965 INFO:teuthology.orchestra.run.trial127.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T03:41:33.965 INFO:teuthology.orchestra.run.trial127.stdout:Installed: 2026-02-13T03:41:33.965 INFO:teuthology.orchestra.run.trial127.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T03:41:33.965 INFO:teuthology.orchestra.run.trial127.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T03:41:33.966 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T03:41:33.966 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:41:33.966 INFO:teuthology.orchestra.run.trial127.stdout:Complete! 2026-02-13T03:41:34.001 DEBUG:teuthology.parallel:result is None 2026-02-13T03:41:34.023 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-13T03:41:34.032 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-13T03:41:34.032 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-13T03:41:34.094 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-13T03:41:34.094 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-13T03:41:34.164 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-13T03:41:34.230 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T03:41:34.237 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T03:41:34.246 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T03:41:34.253 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T03:41:34.258 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T03:41:34.259 INFO:teuthology.orchestra.run.trial070.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:41:34.388 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:41:34.390 INFO:teuthology.orchestra.run.trial070.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:41:34.667 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:41:34.667 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T03:41:34.667 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:41:34.690 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:41:34.900 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:41:34.901 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T03:41:34.901 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T03:41:34.901 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T03:41:34.901 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T03:41:34.901 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T03:41:34.901 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T03:41:34.901 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T03:41:34.955 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:41:34.955 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:41:34.955 INFO:teuthology.orchestra.run.trial070.stdout:Upgraded: 2026-02-13T03:41:34.955 INFO:teuthology.orchestra.run.trial070.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T03:41:34.955 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-13T03:41:34.955 INFO:teuthology.orchestra.run.trial070.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T03:41:34.955 INFO:teuthology.orchestra.run.trial070.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T03:41:34.956 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T03:41:34.956 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:41:34.956 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-13T03:41:34.989 DEBUG:teuthology.parallel:result is None 2026-02-13T03:41:34.989 INFO:teuthology.run_tasks:Running task install... 2026-02-13T03:41:35.004 DEBUG:teuthology.task.install:project ceph 2026-02-13T03:41:35.004 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}} 2026-02-13T03:41:35.005 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'} 2026-02-13T03:41:35.005 INFO:teuthology.task.install:Using flavor: default 2026-02-13T03:41:35.015 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T03:41:35.015 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-13T03:41:35.016 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T03:41:35.017 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:41:35.020 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T03:41:35.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:41:35.022 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T03:41:35.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:41:35.263 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T03:41:35.263 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T03:41:35.272 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T03:41:35.272 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T03:41:35.274 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T03:41:35.274 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T03:41:35.479 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T03:41:35.479 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:41:35.479 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T03:41:35.483 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T03:41:35.483 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:41:35.483 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T03:41:35.487 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T03:41:35.487 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:41:35.487 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T03:41:35.507 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T03:41:35.507 DEBUG:teuthology.orchestra.run.trial177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T03:41:35.511 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T03:41:35.512 DEBUG:teuthology.orchestra.run.trial070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T03:41:35.516 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T03:41:35.516 DEBUG:teuthology.orchestra.run.trial127:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T03:41:35.573 DEBUG:teuthology.orchestra.run.trial177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T03:41:35.577 DEBUG:teuthology.orchestra.run.trial070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T03:41:35.581 DEBUG:teuthology.orchestra.run.trial127:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T03:41:35.647 DEBUG:teuthology.orchestra.run.trial177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T03:41:35.650 DEBUG:teuthology.orchestra.run.trial070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T03:41:35.655 DEBUG:teuthology.orchestra.run.trial127:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T03:41:35.710 INFO:teuthology.orchestra.run.trial177.stdout:check_obsoletes = 1 2026-02-13T03:41:35.712 DEBUG:teuthology.orchestra.run.trial177:> sudo yum clean all 2026-02-13T03:41:35.713 INFO:teuthology.orchestra.run.trial070.stdout:check_obsoletes = 1 2026-02-13T03:41:35.715 DEBUG:teuthology.orchestra.run.trial070:> sudo yum clean all 2026-02-13T03:41:35.719 INFO:teuthology.orchestra.run.trial127.stdout:check_obsoletes = 1 2026-02-13T03:41:35.720 DEBUG:teuthology.orchestra.run.trial127:> sudo yum clean all 2026-02-13T03:41:35.864 INFO:teuthology.orchestra.run.trial070.stdout:41 files removed 2026-02-13T03:41:35.865 INFO:teuthology.orchestra.run.trial177.stdout:41 files removed 2026-02-13T03:41:35.870 INFO:teuthology.orchestra.run.trial127.stdout:41 files removed 2026-02-13T03:41:35.878 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T03:41:35.882 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T03:41:35.884 DEBUG:teuthology.orchestra.run.trial127:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T03:41:36.155 INFO:teuthology.orchestra.run.trial177.stdout:ceph packages for x86_64 720 kB/s | 91 kB 00:00 2026-02-13T03:41:36.158 INFO:teuthology.orchestra.run.trial070.stdout:ceph packages for x86_64 683 kB/s | 91 kB 00:00 2026-02-13T03:41:36.160 INFO:teuthology.orchestra.run.trial127.stdout:ceph packages for x86_64 714 kB/s | 91 kB 00:00 2026-02-13T03:41:36.294 INFO:teuthology.orchestra.run.trial177.stdout:ceph noarch packages 207 kB/s | 23 kB 00:00 2026-02-13T03:41:36.296 INFO:teuthology.orchestra.run.trial070.stdout:ceph noarch packages 209 kB/s | 23 kB 00:00 2026-02-13T03:41:36.299 INFO:teuthology.orchestra.run.trial127.stdout:ceph noarch packages 212 kB/s | 23 kB 00:00 2026-02-13T03:41:36.421 INFO:teuthology.orchestra.run.trial177.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T03:41:36.422 INFO:teuthology.orchestra.run.trial070.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T03:41:36.424 INFO:teuthology.orchestra.run.trial127.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T03:41:37.129 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-13T03:41:37.859 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.9 MB 00:01 2026-02-13T03:41:38.064 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.9 MB 00:01 2026-02-13T03:41:40.249 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-13T03:41:40.618 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-13T03:41:43.774 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 7.8 MB 00:01 2026-02-13T03:41:44.036 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-13T03:41:44.901 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - Extras packages 134 kB/s | 20 kB 00:00 2026-02-13T03:41:45.520 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-13T03:41:45.596 INFO:teuthology.orchestra.run.trial177.stdout:Extra Packages for Enterprise Linux 33 MB/s | 20 MB 00:00 2026-02-13T03:41:46.013 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 27 MB 00:07 2026-02-13T03:41:46.473 INFO:teuthology.orchestra.run.trial070.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-13T03:41:48.795 INFO:teuthology.orchestra.run.trial177.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-13T03:41:49.742 INFO:teuthology.orchestra.run.trial070.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-13T03:41:49.968 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 7.8 MB 00:01 2026-02-13T03:41:50.088 INFO:teuthology.orchestra.run.trial177.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:41:50.088 INFO:teuthology.orchestra.run.trial177.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:41:50.094 INFO:teuthology.orchestra.run.trial177.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T03:41:50.095 INFO:teuthology.orchestra.run.trial177.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T03:41:50.095 INFO:teuthology.orchestra.run.trial177.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T03:41:50.096 INFO:teuthology.orchestra.run.trial177.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T03:41:50.096 INFO:teuthology.orchestra.run.trial177.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T03:41:50.098 INFO:teuthology.orchestra.run.trial177.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T03:41:50.098 INFO:teuthology.orchestra.run.trial177.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T03:41:50.126 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-13T03:41:50.131 INFO:teuthology.orchestra.run.trial177.stdout:======================================================================================= 2026-02-13T03:41:50.131 INFO:teuthology.orchestra.run.trial177.stdout: Package Arch Version Repository Size 2026-02-13T03:41:50.131 INFO:teuthology.orchestra.run.trial177.stdout:======================================================================================= 2026-02-13T03:41:50.131 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-13T03:41:50.131 INFO:teuthology.orchestra.run.trial177.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T03:41:50.132 INFO:teuthology.orchestra.run.trial177.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T03:41:50.133 INFO:teuthology.orchestra.run.trial177.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T03:41:50.134 INFO:teuthology.orchestra.run.trial177.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout:Upgrading: 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T03:41:50.135 INFO:teuthology.orchestra.run.trial177.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout:Installing dependencies: 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T03:41:50.136 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T03:41:50.137 INFO:teuthology.orchestra.run.trial177.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T03:41:50.138 INFO:teuthology.orchestra.run.trial177.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T03:41:50.139 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T03:41:50.140 INFO:teuthology.orchestra.run.trial177.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T03:41:50.141 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T03:41:50.142 INFO:teuthology.orchestra.run.trial177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T03:41:50.143 INFO:teuthology.orchestra.run.trial177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T03:41:50.144 INFO:teuthology.orchestra.run.trial177.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout:Installing weak dependencies: 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout:======================================================================================= 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout:Install 162 Packages 2026-02-13T03:41:50.145 INFO:teuthology.orchestra.run.trial177.stdout:Upgrade 11 Packages 2026-02-13T03:41:50.146 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:41:50.146 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 302 M 2026-02-13T03:41:50.146 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-13T03:41:50.473 INFO:teuthology.orchestra.run.trial177.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 127 kB/s | 6.5 kB 00:00 2026-02-13T03:41:50.593 INFO:teuthology.orchestra.run.trial177.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 8.0 MB/s | 987 kB 00:00 2026-02-13T03:41:50.639 INFO:teuthology.orchestra.run.trial177.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 3.1 MB/s | 147 kB 00:00 2026-02-13T03:41:50.685 INFO:teuthology.orchestra.run.trial177.stdout:(4/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 20 MB/s | 5.2 MB 00:00 2026-02-13T03:41:50.739 INFO:teuthology.orchestra.run.trial177.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 17 MB/s | 940 kB 00:00 2026-02-13T03:41:50.830 INFO:teuthology.orchestra.run.trial177.stdout:(6/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 12 MB/s | 2.4 MB 00:00 2026-02-13T03:41:50.883 INFO:teuthology.orchestra.run.trial177.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 3.1 MB/s | 166 kB 00:00 2026-02-13T03:41:50.959 INFO:teuthology.orchestra.run.trial177.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 23 MB/s | 5.0 MB 00:00 2026-02-13T03:41:51.016 INFO:teuthology.orchestra.run.trial070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:41:51.016 INFO:teuthology.orchestra.run.trial070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:41:51.022 INFO:teuthology.orchestra.run.trial070.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T03:41:51.022 INFO:teuthology.orchestra.run.trial070.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T03:41:51.023 INFO:teuthology.orchestra.run.trial070.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T03:41:51.023 INFO:teuthology.orchestra.run.trial070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T03:41:51.024 INFO:teuthology.orchestra.run.trial070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T03:41:51.025 INFO:teuthology.orchestra.run.trial070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T03:41:51.026 INFO:teuthology.orchestra.run.trial070.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T03:41:51.033 INFO:teuthology.orchestra.run.trial127.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 20 kB 00:00 2026-02-13T03:41:51.053 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-13T03:41:51.058 INFO:teuthology.orchestra.run.trial070.stdout:======================================================================================= 2026-02-13T03:41:51.058 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-13T03:41:51.058 INFO:teuthology.orchestra.run.trial070.stdout:======================================================================================= 2026-02-13T03:41:51.058 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-13T03:41:51.058 INFO:teuthology.orchestra.run.trial070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T03:41:51.058 INFO:teuthology.orchestra.run.trial070.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T03:41:51.058 INFO:teuthology.orchestra.run.trial070.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T03:41:51.059 INFO:teuthology.orchestra.run.trial070.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T03:41:51.060 INFO:teuthology.orchestra.run.trial070.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T03:41:51.061 INFO:teuthology.orchestra.run.trial070.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout:Upgrading: 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T03:41:51.062 INFO:teuthology.orchestra.run.trial070.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T03:41:51.063 INFO:teuthology.orchestra.run.trial070.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T03:41:51.064 INFO:teuthology.orchestra.run.trial070.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T03:41:51.065 INFO:teuthology.orchestra.run.trial070.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T03:41:51.066 INFO:teuthology.orchestra.run.trial070.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T03:41:51.067 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T03:41:51.068 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T03:41:51.069 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T03:41:51.070 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T03:41:51.071 INFO:teuthology.orchestra.run.trial070.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout:Installing weak dependencies: 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T03:41:51.072 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:41:51.073 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-13T03:41:51.073 INFO:teuthology.orchestra.run.trial070.stdout:======================================================================================= 2026-02-13T03:41:51.073 INFO:teuthology.orchestra.run.trial070.stdout:Install 162 Packages 2026-02-13T03:41:51.073 INFO:teuthology.orchestra.run.trial070.stdout:Upgrade 11 Packages 2026-02-13T03:41:51.073 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:41:51.074 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 302 M 2026-02-13T03:41:51.074 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-13T03:41:51.612 INFO:teuthology.orchestra.run.trial070.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 25 kB/s | 6.5 kB 00:00 2026-02-13T03:41:51.634 INFO:teuthology.orchestra.run.trial177.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 20 MB/s | 24 MB 00:01 2026-02-13T03:41:51.859 INFO:teuthology.orchestra.run.trial177.stdout:(10/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 21 MB/s | 19 MB 00:00 2026-02-13T03:41:51.881 INFO:teuthology.orchestra.run.trial177.stdout:(11/173): ceph-osd-classic-20.3.0-5241.g8f8d382 16 MB/s | 16 MB 00:00 2026-02-13T03:41:51.882 INFO:teuthology.orchestra.run.trial177.stdout:(12/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 1.1 MB/s | 25 kB 00:00 2026-02-13T03:41:51.934 INFO:teuthology.orchestra.run.trial177.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 4.5 MB/s | 243 kB 00:00 2026-02-13T03:41:51.970 INFO:teuthology.orchestra.run.trial177.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 767 kB/s | 27 kB 00:00 2026-02-13T03:41:52.007 INFO:teuthology.orchestra.run.trial177.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 1.0 MB/s | 37 kB 00:00 2026-02-13T03:41:52.044 INFO:teuthology.orchestra.run.trial177.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 667 kB/s | 24 kB 00:00 2026-02-13T03:41:52.099 INFO:teuthology.orchestra.run.trial177.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 16 MB/s | 909 kB 00:00 2026-02-13T03:41:52.139 INFO:teuthology.orchestra.run.trial177.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 3.9 MB/s | 159 kB 00:00 2026-02-13T03:41:52.178 INFO:teuthology.orchestra.run.trial177.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 3.1 MB/s | 123 kB 00:00 2026-02-13T03:41:52.186 INFO:teuthology.orchestra.run.trial127.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-13T03:41:52.221 INFO:teuthology.orchestra.run.trial177.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 5.7 MB/s | 248 kB 00:00 2026-02-13T03:41:52.257 INFO:teuthology.orchestra.run.trial177.stdout:(21/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 21 MB/s | 13 MB 00:00 2026-02-13T03:41:52.297 INFO:teuthology.orchestra.run.trial177.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 1.1 MB/s | 45 kB 00:00 2026-02-13T03:41:52.322 INFO:teuthology.orchestra.run.trial070.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.4 MB/s | 987 kB 00:00 2026-02-13T03:41:52.340 INFO:teuthology.orchestra.run.trial177.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 4.2 MB/s | 185 kB 00:00 2026-02-13T03:41:52.385 INFO:teuthology.orchestra.run.trial177.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 4.5 MB/s | 204 kB 00:00 2026-02-13T03:41:52.432 INFO:teuthology.orchestra.run.trial177.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 6.8 MB/s | 324 kB 00:00 2026-02-13T03:41:52.453 INFO:teuthology.orchestra.run.trial070.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 1.1 MB/s | 147 kB 00:00 2026-02-13T03:41:52.478 INFO:teuthology.orchestra.run.trial177.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 6.5 MB/s | 306 kB 00:00 2026-02-13T03:41:52.516 INFO:teuthology.orchestra.run.trial177.stdout:(27/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 22 MB/s | 6.5 MB 00:00 2026-02-13T03:41:52.516 INFO:teuthology.orchestra.run.trial177.stdout:(28/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 2.5 MB/s | 100 kB 00:00 2026-02-13T03:41:52.543 INFO:teuthology.orchestra.run.trial177.stdout:(29/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 3.0 MB/s | 84 kB 00:00 2026-02-13T03:41:52.584 INFO:teuthology.orchestra.run.trial177.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 4.1 MB/s | 172 kB 00:00 2026-02-13T03:41:52.624 INFO:teuthology.orchestra.run.trial177.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.4 MB/s | 57 kB 00:00 2026-02-13T03:41:52.668 INFO:teuthology.orchestra.run.trial177.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 4.2 MB/s | 183 kB 00:00 2026-02-13T03:41:52.672 INFO:teuthology.orchestra.run.trial177.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 18 MB/s | 2.9 MB 00:00 2026-02-13T03:41:53.187 INFO:teuthology.orchestra.run.trial177.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 14 MB/s | 7.4 MB 00:00 2026-02-13T03:41:53.236 INFO:teuthology.orchestra.run.trial177.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 5.9 MB/s | 297 kB 00:00 2026-02-13T03:41:53.281 INFO:teuthology.orchestra.run.trial177.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 1.1 MB/s | 50 kB 00:00 2026-02-13T03:41:53.325 INFO:teuthology.orchestra.run.trial177.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 391 kB/s | 17 kB 00:00 2026-02-13T03:41:53.376 INFO:teuthology.orchestra.run.trial177.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 5.8 MB/s | 299 kB 00:00 2026-02-13T03:41:53.460 INFO:teuthology.orchestra.run.trial177.stdout:(39/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 19 MB/s | 15 MB 00:00 2026-02-13T03:41:53.465 INFO:teuthology.orchestra.run.trial177.stdout:(40/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 11 MB/s | 1.0 MB 00:00 2026-02-13T03:41:53.490 INFO:teuthology.orchestra.run.trial177.stdout:(41/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 611 kB/s | 18 kB 00:00 2026-02-13T03:41:53.571 INFO:teuthology.orchestra.run.trial177.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.2 MB/s | 350 kB 00:00 2026-02-13T03:41:53.593 INFO:teuthology.orchestra.run.trial177.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.8 MB/s | 40 kB 00:00 2026-02-13T03:41:53.614 INFO:teuthology.orchestra.run.trial177.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 23 kB 00:00 2026-02-13T03:41:53.636 INFO:teuthology.orchestra.run.trial177.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 3.2 MB/s | 72 kB 00:00 2026-02-13T03:41:53.641 INFO:teuthology.orchestra.run.trial177.stdout:(46/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2026-02-13T03:41:53.664 INFO:teuthology.orchestra.run.trial177.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 7.7 MB/s | 184 kB 00:00 2026-02-13T03:41:53.679 INFO:teuthology.orchestra.run.trial177.stdout:(48/173): libgfortran-11.5.0-14.el9.x86_64.rpm 18 MB/s | 794 kB 00:00 2026-02-13T03:41:53.687 INFO:teuthology.orchestra.run.trial177.stdout:(49/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 4.1 MB/s | 94 kB 00:00 2026-02-13T03:41:53.701 INFO:teuthology.orchestra.run.trial177.stdout:(50/173): mailcap-2.1.49-5.el9.noarch.rpm 1.5 MB/s | 33 kB 00:00 2026-02-13T03:41:53.709 INFO:teuthology.orchestra.run.trial177.stdout:(51/173): pciutils-3.7.0-7.el9.x86_64.rpm 4.2 MB/s | 93 kB 00:00 2026-02-13T03:41:53.727 INFO:teuthology.orchestra.run.trial177.stdout:(52/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 9.3 MB/s | 253 kB 00:00 2026-02-13T03:41:53.736 INFO:teuthology.orchestra.run.trial177.stdout:(53/173): python3-cryptography-36.0.1-5.el9.x86 46 MB/s | 1.2 MB 00:00 2026-02-13T03:41:53.750 INFO:teuthology.orchestra.run.trial177.stdout:(54/173): python3-ply-3.11-14.el9.noarch.rpm 4.5 MB/s | 106 kB 00:00 2026-02-13T03:41:53.751 INFO:teuthology.orchestra.run.trial070.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 1.8 MB/s | 2.4 MB 00:01 2026-02-13T03:41:53.760 INFO:teuthology.orchestra.run.trial177.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 5.6 MB/s | 135 kB 00:00 2026-02-13T03:41:53.774 INFO:teuthology.orchestra.run.trial177.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 5.3 MB/s | 126 kB 00:00 2026-02-13T03:41:53.782 INFO:teuthology.orchestra.run.trial177.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 9.6 MB/s | 218 kB 00:00 2026-02-13T03:41:53.797 INFO:teuthology.orchestra.run.trial177.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 7.7 MB/s | 182 kB 00:00 2026-02-13T03:41:53.806 INFO:teuthology.orchestra.run.trial177.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-13T03:41:53.855 INFO:teuthology.orchestra.run.trial070.stdout:(5/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 2.1 MB/s | 5.2 MB 00:02 2026-02-13T03:41:53.988 INFO:teuthology.orchestra.run.trial177.stdout:(60/173): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2026-02-13T03:41:54.008 INFO:teuthology.orchestra.run.trial177.stdout:(61/173): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2026-02-13T03:41:54.015 INFO:teuthology.orchestra.run.trial177.stdout:(62/173): boost-program-options-1.75.0-13.el9.x 3.8 MB/s | 104 kB 00:00 2026-02-13T03:41:54.035 INFO:teuthology.orchestra.run.trial177.stdout:(63/173): elfutils-libelf-devel-0.194-1.el9.x86 3.0 MB/s | 79 kB 00:00 2026-02-13T03:41:54.039 INFO:teuthology.orchestra.run.trial070.stdout:(6/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 3.2 MB/s | 940 kB 00:00 2026-02-13T03:41:54.046 INFO:teuthology.orchestra.run.trial177.stdout:(64/173): flex-2.6.4-9.el9.x86_64.rpm 9.8 MB/s | 313 kB 00:00 2026-02-13T03:41:54.060 INFO:teuthology.orchestra.run.trial177.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 1.3 MB/s | 33 kB 00:00 2026-02-13T03:41:54.085 INFO:teuthology.orchestra.run.trial177.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 730 kB/s | 18 kB 00:00 2026-02-13T03:41:54.093 INFO:teuthology.orchestra.run.trial070.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 3.0 MB/s | 166 kB 00:00 2026-02-13T03:41:54.109 INFO:teuthology.orchestra.run.trial177.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 451 kB/s | 11 kB 00:00 2026-02-13T03:41:54.129 INFO:teuthology.orchestra.run.trial177.stdout:(68/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2026-02-13T03:41:54.136 INFO:teuthology.orchestra.run.trial177.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 5.9 MB/s | 164 kB 00:00 2026-02-13T03:41:54.158 INFO:teuthology.orchestra.run.trial177.stdout:(70/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.5 MB/s | 160 kB 00:00 2026-02-13T03:41:54.162 INFO:teuthology.orchestra.run.trial177.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-13T03:41:54.190 INFO:teuthology.orchestra.run.trial177.stdout:(72/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 8.6 MB/s | 246 kB 00:00 2026-02-13T03:41:54.196 INFO:teuthology.orchestra.run.trial177.stdout:(73/173): librdkafka-1.6.1-102.el9.x86_64.rpm 17 MB/s | 662 kB 00:00 2026-02-13T03:41:54.221 INFO:teuthology.orchestra.run.trial177.stdout:(74/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 974 kB/s | 25 kB 00:00 2026-02-13T03:41:54.225 INFO:teuthology.orchestra.run.trial177.stdout:(75/173): libtool-2.4.6-46.el9.x86_64.rpm 17 MB/s | 581 kB 00:00 2026-02-13T03:41:54.249 INFO:teuthology.orchestra.run.trial177.stdout:(76/173): libxslt-1.1.34-12.el9.x86_64.rpm 8.2 MB/s | 233 kB 00:00 2026-02-13T03:41:54.250 INFO:teuthology.orchestra.run.trial177.stdout:(77/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 1.9 MB/s | 51 kB 00:00 2026-02-13T03:41:54.278 INFO:teuthology.orchestra.run.trial177.stdout:(78/173): lua-5.4.4-4.el9.x86_64.rpm 6.8 MB/s | 188 kB 00:00 2026-02-13T03:41:54.280 INFO:teuthology.orchestra.run.trial177.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.3 MB/s | 292 kB 00:00 2026-02-13T03:41:54.412 INFO:teuthology.orchestra.run.trial177.stdout:(80/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 31 MB/s | 78 MB 00:02 2026-02-13T03:41:54.413 INFO:teuthology.orchestra.run.trial177.stdout:(81/173): openblas-0.3.29-1.el9.x86_64.rpm 311 kB/s | 42 kB 00:00 2026-02-13T03:41:54.438 INFO:teuthology.orchestra.run.trial177.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 882 kB/s | 22 kB 00:00 2026-02-13T03:41:54.448 INFO:teuthology.orchestra.run.trial177.stdout:(83/173): openblas-openmp-0.3.29-1.el9.x86_64.r 31 MB/s | 5.3 MB 00:00 2026-02-13T03:41:54.464 INFO:teuthology.orchestra.run.trial177.stdout:(84/173): perl-threads-2.25-460.el9.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2026-02-13T03:41:54.474 INFO:teuthology.orchestra.run.trial177.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 1.7 MB/s | 45 kB 00:00 2026-02-13T03:41:54.504 INFO:teuthology.orchestra.run.trial177.stdout:(86/173): postgresql-contrib-13.23-1.el9.x86_64 30 MB/s | 903 kB 00:00 2026-02-13T03:41:54.519 INFO:teuthology.orchestra.run.trial177.stdout:(87/173): postgresql-13.23-1.el9.x86_64.rpm 30 MB/s | 1.6 MB 00:00 2026-02-13T03:41:54.531 INFO:teuthology.orchestra.run.trial177.stdout:(88/173): postgresql-private-libs-13.23-1.el9.x 5.0 MB/s | 138 kB 00:00 2026-02-13T03:41:54.558 INFO:teuthology.orchestra.run.trial070.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 7.1 MB/s | 5.0 MB 00:00 2026-02-13T03:41:54.562 INFO:teuthology.orchestra.run.trial177.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 33 MB/s | 1.0 MB 00:00 2026-02-13T03:41:54.596 INFO:teuthology.orchestra.run.trial177.stdout:(90/173): postgresql-server-13.23-1.el9.x86_64. 75 MB/s | 5.8 MB 00:00 2026-02-13T03:41:54.623 INFO:teuthology.orchestra.run.trial177.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 2.3 MB/s | 61 kB 00:00 2026-02-13T03:41:54.644 INFO:teuthology.orchestra.run.trial177.stdout:(92/173): python3-babel-2.9.1-2.el9.noarch.rpm 73 MB/s | 6.0 MB 00:00 2026-02-13T03:41:54.650 INFO:teuthology.orchestra.run.trial177.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 8.8 MB/s | 244 kB 00:00 2026-02-13T03:41:54.672 INFO:teuthology.orchestra.run.trial177.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 8.6 MB/s | 249 kB 00:00 2026-02-13T03:41:54.676 INFO:teuthology.orchestra.run.trial177.stdout:(95/173): python3-jmespath-1.0.1-1.el9.noarch.r 1.8 MB/s | 48 kB 00:00 2026-02-13T03:41:54.690 INFO:teuthology.orchestra.run.trial177.stdout:(96/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2026-02-13T03:41:54.701 INFO:teuthology.orchestra.run.trial177.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 6.2 MB/s | 177 kB 00:00 2026-02-13T03:41:54.702 INFO:teuthology.orchestra.run.trial177.stdout:(98/173): python3-markupsafe-1.1.1-12.el9.x86_6 1.3 MB/s | 35 kB 00:00 2026-02-13T03:41:54.728 INFO:teuthology.orchestra.run.trial177.stdout:(99/173): python3-packaging-20.9-5.el9.noarch.r 2.9 MB/s | 77 kB 00:00 2026-02-13T03:41:54.729 INFO:teuthology.orchestra.run.trial177.stdout:(100/173): python3-numpy-f2py-1.23.5-2.el9.x86_ 15 MB/s | 442 kB 00:00 2026-02-13T03:41:54.756 INFO:teuthology.orchestra.run.trial177.stdout:(101/173): python3-protobuf-3.14.0-17.el9.noarc 9.3 MB/s | 267 kB 00:00 2026-02-13T03:41:54.757 INFO:teuthology.orchestra.run.trial177.stdout:(102/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 5.6 MB/s | 159 kB 00:00 2026-02-13T03:41:54.772 INFO:teuthology.orchestra.run.trial177.stdout:(103/173): python3-numpy-1.23.5-2.el9.x86_64.rp 74 MB/s | 6.1 MB 00:00 2026-02-13T03:41:54.784 INFO:teuthology.orchestra.run.trial177.stdout:(104/173): python3-requests-oauthlib-1.3.0-12.e 2.0 MB/s | 54 kB 00:00 2026-02-13T03:41:54.785 INFO:teuthology.orchestra.run.trial177.stdout:(105/173): python3-pyasn1-modules-0.4.8-6.el9.n 9.7 MB/s | 279 kB 00:00 2026-02-13T03:41:54.810 INFO:teuthology.orchestra.run.trial177.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-13T03:41:54.810 INFO:teuthology.orchestra.run.trial177.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 1.7 MB/s | 44 kB 00:00 2026-02-13T03:41:54.836 INFO:teuthology.orchestra.run.trial177.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 9.0 MB/s | 240 kB 00:00 2026-02-13T03:41:54.836 INFO:teuthology.orchestra.run.trial177.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 1.4 MB/s | 37 kB 00:00 2026-02-13T03:41:54.862 INFO:teuthology.orchestra.run.trial177.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-13T03:41:54.863 INFO:teuthology.orchestra.run.trial177.stdout:(111/173): socat-1.7.4.1-8.el9.x86_64.rpm 11 MB/s | 303 kB 00:00 2026-02-13T03:41:54.887 INFO:teuthology.orchestra.run.trial177.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2026-02-13T03:41:54.889 INFO:teuthology.orchestra.run.trial177.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 3.6 MB/s | 96 kB 00:00 2026-02-13T03:41:54.913 INFO:teuthology.orchestra.run.trial177.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2026-02-13T03:41:54.914 INFO:teuthology.orchestra.run.trial177.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-13T03:41:54.955 INFO:teuthology.orchestra.run.trial177.stdout:(116/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 105 MB/s | 19 MB 00:00 2026-02-13T03:41:55.015 INFO:teuthology.orchestra.run.trial177.stdout:(117/173): lua-devel-5.4.4-4.el9.x86_64.rpm 219 kB/s | 22 kB 00:00 2026-02-13T03:41:55.110 INFO:teuthology.orchestra.run.trial177.stdout:(118/173): protobuf-compiler-3.14.0-17.el9.x86_ 4.3 MB/s | 862 kB 00:00 2026-02-13T03:41:55.361 INFO:teuthology.orchestra.run.trial177.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 77 kB/s | 19 kB 00:00 2026-02-13T03:41:55.427 INFO:teuthology.orchestra.run.trial127.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-13T03:41:55.469 INFO:teuthology.orchestra.run.trial177.stdout:(120/173): gperftools-libs-2.9.1-3.el9.x86_64.r 677 kB/s | 308 kB 00:00 2026-02-13T03:41:55.479 INFO:teuthology.orchestra.run.trial177.stdout:(121/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.0 MB/s | 551 kB 00:00 2026-02-13T03:41:55.501 INFO:teuthology.orchestra.run.trial070.stdout:(9/173): ceph-osd-classic-20.3.0-5241.g8f8d3829 11 MB/s | 16 MB 00:01 2026-02-13T03:41:55.533 INFO:teuthology.orchestra.run.trial177.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 388 kB/s | 25 kB 00:00 2026-02-13T03:41:55.543 INFO:teuthology.orchestra.run.trial177.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 762 kB/s | 49 kB 00:00 2026-02-13T03:41:55.544 INFO:teuthology.orchestra.run.trial070.stdout:(10/173): ceph-common-20.3.0-5241.g8f8d3829.el9 5.8 MB/s | 24 MB 00:04 2026-02-13T03:41:55.556 INFO:teuthology.orchestra.run.trial070.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 2.1 MB/s | 25 kB 00:00 2026-02-13T03:41:55.602 INFO:teuthology.orchestra.run.trial177.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 971 kB/s | 67 kB 00:00 2026-02-13T03:41:55.630 INFO:teuthology.orchestra.run.trial177.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 1.7 MB/s | 151 kB 00:00 2026-02-13T03:41:55.745 INFO:teuthology.orchestra.run.trial177.stdout:(126/173): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2026-02-13T03:41:55.778 INFO:teuthology.orchestra.run.trial177.stdout:(127/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.7 MB/s | 838 kB 00:00 2026-02-13T03:41:55.787 INFO:teuthology.orchestra.run.trial070.stdout:(12/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 16 MB/s | 19 MB 00:01 2026-02-13T03:41:55.809 INFO:teuthology.orchestra.run.trial177.stdout:(128/173): python3-autocommand-2.2.2-8.el9.noar 467 kB/s | 29 kB 00:00 2026-02-13T03:41:55.810 INFO:teuthology.orchestra.run.trial070.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 10 MB/s | 243 kB 00:00 2026-02-13T03:41:55.822 INFO:teuthology.orchestra.run.trial070.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 2.3 MB/s | 27 kB 00:00 2026-02-13T03:41:55.833 INFO:teuthology.orchestra.run.trial070.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 3.2 MB/s | 37 kB 00:00 2026-02-13T03:41:55.841 INFO:teuthology.orchestra.run.trial177.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 951 kB/s | 60 kB 00:00 2026-02-13T03:41:55.845 INFO:teuthology.orchestra.run.trial070.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 2.1 MB/s | 24 kB 00:00 2026-02-13T03:41:55.866 INFO:teuthology.orchestra.run.trial177.stdout:(130/173): libarrow-9.0.0-15.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2026-02-13T03:41:55.873 INFO:teuthology.orchestra.run.trial177.stdout:(131/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 679 kB/s | 43 kB 00:00 2026-02-13T03:41:55.901 INFO:teuthology.orchestra.run.trial070.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 16 MB/s | 909 kB 00:00 2026-02-13T03:41:55.913 INFO:teuthology.orchestra.run.trial070.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 13 MB/s | 159 kB 00:00 2026-02-13T03:41:55.914 INFO:teuthology.orchestra.run.trial177.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 447 kB/s | 32 kB 00:00 2026-02-13T03:41:55.925 INFO:teuthology.orchestra.run.trial070.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 10 MB/s | 123 kB 00:00 2026-02-13T03:41:55.928 INFO:teuthology.orchestra.run.trial177.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 230 kB/s | 14 kB 00:00 2026-02-13T03:41:55.945 INFO:teuthology.orchestra.run.trial177.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 2.3 MB/s | 173 kB 00:00 2026-02-13T03:41:55.948 INFO:teuthology.orchestra.run.trial070.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 11 MB/s | 248 kB 00:00 2026-02-13T03:41:55.991 INFO:teuthology.orchestra.run.trial177.stdout:(135/173): python3-cherrypy-18.6.1-2.el9.noarch 4.5 MB/s | 358 kB 00:00 2026-02-13T03:41:55.999 INFO:teuthology.orchestra.run.trial177.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.1 MB/s | 303 kB 00:00 2026-02-13T03:41:56.031 INFO:teuthology.orchestra.run.trial177.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 2.9 MB/s | 254 kB 00:00 2026-02-13T03:41:56.062 INFO:teuthology.orchestra.run.trial177.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 2.3 MB/s | 144 kB 00:00 2026-02-13T03:41:56.092 INFO:teuthology.orchestra.run.trial177.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 173 kB/s | 11 kB 00:00 2026-02-13T03:41:56.123 INFO:teuthology.orchestra.run.trial177.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 288 kB/s | 18 kB 00:00 2026-02-13T03:41:56.151 INFO:teuthology.orchestra.run.trial177.stdout:(141/173): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2026-02-13T03:41:56.155 INFO:teuthology.orchestra.run.trial177.stdout:(142/173): python3-jaraco-collections-3.0.0-8.e 372 kB/s | 23 kB 00:00 2026-02-13T03:41:56.184 INFO:teuthology.orchestra.run.trial177.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 321 kB/s | 20 kB 00:00 2026-02-13T03:41:56.213 INFO:teuthology.orchestra.run.trial177.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 318 kB/s | 19 kB 00:00 2026-02-13T03:41:56.217 INFO:teuthology.orchestra.run.trial177.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 423 kB/s | 26 kB 00:00 2026-02-13T03:41:56.264 INFO:teuthology.orchestra.run.trial177.stdout:(146/173): python3-kubernetes-26.1.0-3.el9.noar 13 MB/s | 1.0 MB 00:00 2026-02-13T03:41:56.275 INFO:teuthology.orchestra.run.trial177.stdout:(147/173): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2026-02-13T03:41:56.282 INFO:teuthology.orchestra.run.trial070.stdout:(21/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 19 MB/s | 6.5 MB 00:00 2026-02-13T03:41:56.282 INFO:teuthology.orchestra.run.trial177.stdout:(148/173): python3-natsort-7.1.1-5.el9.noarch.r 887 kB/s | 58 kB 00:00 2026-02-13T03:41:56.299 INFO:teuthology.orchestra.run.trial070.stdout:(22/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 17 MB/s | 13 MB 00:00 2026-02-13T03:41:56.300 INFO:teuthology.orchestra.run.trial070.stdout:(23/173): python3-ceph-argparse-20.3.0-5241.g8f 2.5 MB/s | 45 kB 00:00 2026-02-13T03:41:56.312 INFO:teuthology.orchestra.run.trial070.stdout:(24/173): python3-ceph-common-20.3.0-5241.g8f8d 15 MB/s | 185 kB 00:00 2026-02-13T03:41:56.313 INFO:teuthology.orchestra.run.trial070.stdout:(25/173): python3-cephfs-20.3.0-5241.g8f8d3829. 16 MB/s | 204 kB 00:00 2026-02-13T03:41:56.325 INFO:teuthology.orchestra.run.trial177.stdout:(149/173): python3-portend-3.1.0-2.el9.noarch.r 268 kB/s | 16 kB 00:00 2026-02-13T03:41:56.334 INFO:teuthology.orchestra.run.trial070.stdout:(26/173): python3-rados-20.3.0-5241.g8f8d3829.e 14 MB/s | 324 kB 00:00 2026-02-13T03:41:56.335 INFO:teuthology.orchestra.run.trial070.stdout:(27/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 13 MB/s | 306 kB 00:00 2026-02-13T03:41:56.337 INFO:teuthology.orchestra.run.trial177.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.4 MB/s | 90 kB 00:00 2026-02-13T03:41:56.346 INFO:teuthology.orchestra.run.trial070.stdout:(28/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 8.5 MB/s | 100 kB 00:00 2026-02-13T03:41:56.347 INFO:teuthology.orchestra.run.trial070.stdout:(29/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 7.2 MB/s | 84 kB 00:00 2026-02-13T03:41:56.354 INFO:teuthology.orchestra.run.trial177.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 392 kB/s | 28 kB 00:00 2026-02-13T03:41:56.362 INFO:teuthology.orchestra.run.trial070.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 11 MB/s | 172 kB 00:00 2026-02-13T03:41:56.374 INFO:teuthology.orchestra.run.trial070.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 4.9 MB/s | 57 kB 00:00 2026-02-13T03:41:56.386 INFO:teuthology.orchestra.run.trial070.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 15 MB/s | 183 kB 00:00 2026-02-13T03:41:56.387 INFO:teuthology.orchestra.run.trial177.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 502 kB/s | 31 kB 00:00 2026-02-13T03:41:56.401 INFO:teuthology.orchestra.run.trial177.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 2.9 MB/s | 188 kB 00:00 2026-02-13T03:41:56.428 INFO:teuthology.orchestra.run.trial177.stdout:(154/173): python3-rsa-4.9-2.el9.noarch.rpm 807 kB/s | 59 kB 00:00 2026-02-13T03:41:56.448 INFO:teuthology.orchestra.run.trial177.stdout:(155/173): python3-tempora-5.0.0-2.el9.noarch.r 583 kB/s | 36 kB 00:00 2026-02-13T03:41:56.471 INFO:teuthology.orchestra.run.trial177.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 1.2 MB/s | 86 kB 00:00 2026-02-13T03:41:56.498 INFO:teuthology.orchestra.run.trial070.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 19 MB/s | 2.9 MB 00:00 2026-02-13T03:41:56.506 INFO:teuthology.orchestra.run.trial177.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2026-02-13T03:41:56.509 INFO:teuthology.orchestra.run.trial177.stdout:(158/173): python3-xmltodict-0.12.0-15.el9.noar 362 kB/s | 22 kB 00:00 2026-02-13T03:41:56.532 INFO:teuthology.orchestra.run.trial177.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 326 kB/s | 20 kB 00:00 2026-02-13T03:41:56.580 INFO:teuthology.orchestra.run.trial177.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2026-02-13T03:41:56.587 INFO:teuthology.orchestra.run.trial177.stdout:(161/173): thrift-0.15.0-4.el9.x86_64.rpm 20 MB/s | 1.6 MB 00:00 2026-02-13T03:41:56.608 INFO:teuthology.orchestra.run.trial177.stdout:(162/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2026-02-13T03:41:56.706 INFO:teuthology.orchestra.run.trial127.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:41:56.707 INFO:teuthology.orchestra.run.trial127.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:41:56.713 INFO:teuthology.orchestra.run.trial127.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T03:41:56.713 INFO:teuthology.orchestra.run.trial127.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T03:41:56.714 INFO:teuthology.orchestra.run.trial127.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T03:41:56.714 INFO:teuthology.orchestra.run.trial127.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T03:41:56.715 INFO:teuthology.orchestra.run.trial127.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T03:41:56.716 INFO:teuthology.orchestra.run.trial127.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T03:41:56.717 INFO:teuthology.orchestra.run.trial127.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T03:41:56.744 INFO:teuthology.orchestra.run.trial127.stdout:Dependencies resolved. 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout:======================================================================================= 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: Package Arch Version Repository Size 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout:======================================================================================= 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout:Installing: 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T03:41:56.749 INFO:teuthology.orchestra.run.trial127.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout:Upgrading: 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout:Installing dependencies: 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T03:41:56.750 INFO:teuthology.orchestra.run.trial127.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T03:41:56.751 INFO:teuthology.orchestra.run.trial127.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T03:41:56.752 INFO:teuthology.orchestra.run.trial127.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout:Installing weak dependencies: 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout:Transaction Summary 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout:======================================================================================= 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout:Install 162 Packages 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout:Upgrade 11 Packages 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout:Total download size: 302 M 2026-02-13T03:41:56.753 INFO:teuthology.orchestra.run.trial127.stdout:Downloading Packages: 2026-02-13T03:41:56.777 INFO:teuthology.orchestra.run.trial177.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 14 MB/s | 2.4 MB 00:00 2026-02-13T03:41:56.803 INFO:teuthology.orchestra.run.trial177.stdout:(164/173): librados2-20.3.0-5241.g8f8d3829.el9. 16 MB/s | 3.5 MB 00:00 2026-02-13T03:41:56.808 INFO:teuthology.orchestra.run.trial177.stdout:(165/173): NetworkManager-libnm-1.54.3-2.el9.x8 63 MB/s | 1.9 MB 00:00 2026-02-13T03:41:56.814 INFO:teuthology.orchestra.run.trial177.stdout:(166/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 12 MB/s | 2.8 MB 00:00 2026-02-13T03:41:56.825 INFO:teuthology.orchestra.run.trial177.stdout:(167/173): NetworkManager-team-1.54.3-2.el9.x86 1.6 MB/s | 37 kB 00:00 2026-02-13T03:41:56.831 INFO:teuthology.orchestra.run.trial177.stdout:(168/173): NetworkManager-tui-1.54.3-2.el9.x86_ 10 MB/s | 248 kB 00:00 2026-02-13T03:41:56.859 INFO:teuthology.orchestra.run.trial177.stdout:(169/173): openssl-3.5.5-1.el9.x86_64.rpm 55 MB/s | 1.5 MB 00:00 2026-02-13T03:41:56.884 INFO:teuthology.orchestra.run.trial177.stdout:(170/173): openssl-fips-provider-3.5.5-1.el9.x8 32 MB/s | 814 kB 00:00 2026-02-13T03:41:56.889 INFO:teuthology.orchestra.run.trial177.stdout:(171/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 6.9 MB/s | 454 kB 00:00 2026-02-13T03:41:56.912 INFO:teuthology.orchestra.run.trial177.stdout:(172/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 81 MB/s | 2.3 MB 00:00 2026-02-13T03:41:56.941 INFO:teuthology.orchestra.run.trial177.stdout:(173/173): iproute-6.17.0-2.el9.x86_64.rpm 6.7 MB/s | 866 kB 00:00 2026-02-13T03:41:56.945 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:41:56.945 INFO:teuthology.orchestra.run.trial177.stdout:Total 44 MB/s | 302 MB 00:06 2026-02-13T03:41:57.019 INFO:teuthology.orchestra.run.trial070.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 14 MB/s | 7.4 MB 00:00 2026-02-13T03:41:57.042 INFO:teuthology.orchestra.run.trial070.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 13 MB/s | 297 kB 00:00 2026-02-13T03:41:57.053 INFO:teuthology.orchestra.run.trial070.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 4.3 MB/s | 50 kB 00:00 2026-02-13T03:41:57.065 INFO:teuthology.orchestra.run.trial070.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 1.5 MB/s | 17 kB 00:00 2026-02-13T03:41:57.089 INFO:teuthology.orchestra.run.trial070.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 12 MB/s | 299 kB 00:00 2026-02-13T03:41:57.101 INFO:teuthology.orchestra.run.trial127.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 110 kB/s | 6.5 kB 00:00 2026-02-13T03:41:57.154 INFO:teuthology.orchestra.run.trial070.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 16 MB/s | 1.0 MB 00:00 2026-02-13T03:41:57.169 INFO:teuthology.orchestra.run.trial070.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 1.2 MB/s | 18 kB 00:00 2026-02-13T03:41:57.249 INFO:teuthology.orchestra.run.trial127.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 6.5 MB/s | 987 kB 00:00 2026-02-13T03:41:57.266 INFO:teuthology.orchestra.run.trial127.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 8.2 MB/s | 147 kB 00:00 2026-02-13T03:41:57.277 INFO:teuthology.orchestra.run.trial070.stdout:(41/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 17 MB/s | 15 MB 00:00 2026-02-13T03:41:57.337 INFO:teuthology.orchestra.run.trial070.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.0 MB/s | 350 kB 00:00 2026-02-13T03:41:57.360 INFO:teuthology.orchestra.run.trial070.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.7 MB/s | 40 kB 00:00 2026-02-13T03:41:57.382 INFO:teuthology.orchestra.run.trial070.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 23 kB 00:00 2026-02-13T03:41:57.417 INFO:teuthology.orchestra.run.trial070.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 2.0 MB/s | 72 kB 00:00 2026-02-13T03:41:57.427 INFO:teuthology.orchestra.run.trial127.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 15 MB/s | 2.4 MB 00:00 2026-02-13T03:41:57.449 INFO:teuthology.orchestra.run.trial070.stdout:(46/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2026-02-13T03:41:57.459 INFO:teuthology.orchestra.run.trial070.stdout:(47/173): libgfortran-11.5.0-14.el9.x86_64.rpm 19 MB/s | 794 kB 00:00 2026-02-13T03:41:57.471 INFO:teuthology.orchestra.run.trial070.stdout:(48/173): libquadmath-11.5.0-14.el9.x86_64.rpm 8.4 MB/s | 184 kB 00:00 2026-02-13T03:41:57.484 INFO:teuthology.orchestra.run.trial127.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 16 MB/s | 940 kB 00:00 2026-02-13T03:41:57.501 INFO:teuthology.orchestra.run.trial070.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 1.1 MB/s | 33 kB 00:00 2026-02-13T03:41:57.502 INFO:teuthology.orchestra.run.trial070.stdout:(50/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 2.1 MB/s | 94 kB 00:00 2026-02-13T03:41:57.523 INFO:teuthology.orchestra.run.trial070.stdout:(51/173): pciutils-3.7.0-7.el9.x86_64.rpm 4.1 MB/s | 93 kB 00:00 2026-02-13T03:41:57.526 INFO:teuthology.orchestra.run.trial070.stdout:(52/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 10 MB/s | 253 kB 00:00 2026-02-13T03:41:57.546 INFO:teuthology.orchestra.run.trial070.stdout:(53/173): python3-cryptography-36.0.1-5.el9.x86 54 MB/s | 1.2 MB 00:00 2026-02-13T03:41:57.548 INFO:teuthology.orchestra.run.trial070.stdout:(54/173): python3-ply-3.11-14.el9.noarch.rpm 4.7 MB/s | 106 kB 00:00 2026-02-13T03:41:57.568 INFO:teuthology.orchestra.run.trial070.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 5.9 MB/s | 135 kB 00:00 2026-02-13T03:41:57.571 INFO:teuthology.orchestra.run.trial070.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 5.4 MB/s | 126 kB 00:00 2026-02-13T03:41:57.589 INFO:teuthology.orchestra.run.trial070.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 10 MB/s | 218 kB 00:00 2026-02-13T03:41:57.590 INFO:teuthology.orchestra.run.trial127.stdout:(6/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 9.5 MB/s | 5.2 MB 00:00 2026-02-13T03:41:57.594 INFO:teuthology.orchestra.run.trial070.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 7.8 MB/s | 182 kB 00:00 2026-02-13T03:41:57.611 INFO:teuthology.orchestra.run.trial070.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 12 MB/s | 266 kB 00:00 2026-02-13T03:41:57.612 INFO:teuthology.orchestra.run.trial127.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 7.4 MB/s | 166 kB 00:00 2026-02-13T03:41:57.744 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-13T03:41:57.770 INFO:teuthology.orchestra.run.trial127.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 17 MB/s | 5.0 MB 00:00 2026-02-13T03:41:57.814 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-13T03:41:57.814 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-13T03:41:58.503 INFO:teuthology.orchestra.run.trial070.stdout:(60/173): automake-1.16.2-8.el9.noarch.rpm 758 kB/s | 689 kB 00:00 2026-02-13T03:41:58.535 INFO:teuthology.orchestra.run.trial070.stdout:(61/173): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2026-02-13T03:41:58.893 INFO:teuthology.orchestra.run.trial127.stdout:(9/173): ceph-osd-classic-20.3.0-5241.g8f8d3829 12 MB/s | 16 MB 00:01 2026-02-13T03:41:58.908 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-13T03:41:58.909 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-13T03:41:58.956 INFO:teuthology.orchestra.run.trial127.stdout:(10/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 16 MB/s | 19 MB 00:01 2026-02-13T03:41:59.006 INFO:teuthology.orchestra.run.trial127.stdout:(11/173): ceph-common-20.3.0-5241.g8f8d3829.el9 12 MB/s | 24 MB 00:01 2026-02-13T03:41:59.010 INFO:teuthology.orchestra.run.trial127.stdout:(12/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 469 kB/s | 25 kB 00:00 2026-02-13T03:41:59.082 INFO:teuthology.orchestra.run.trial127.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 3.3 MB/s | 243 kB 00:00 2026-02-13T03:41:59.143 INFO:teuthology.orchestra.run.trial127.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 444 kB/s | 27 kB 00:00 2026-02-13T03:41:59.169 INFO:teuthology.orchestra.run.trial070.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 125 kB/s | 79 kB 00:00 2026-02-13T03:41:59.172 INFO:teuthology.orchestra.run.trial070.stdout:(63/173): boost-program-options-1.75.0-13.el9.x 156 kB/s | 104 kB 00:00 2026-02-13T03:41:59.201 INFO:teuthology.orchestra.run.trial127.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 648 kB/s | 37 kB 00:00 2026-02-13T03:41:59.264 INFO:teuthology.orchestra.run.trial127.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 390 kB/s | 24 kB 00:00 2026-02-13T03:41:59.730 INFO:teuthology.orchestra.run.trial070.stdout:(64/173): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2026-02-13T03:41:59.737 INFO:teuthology.orchestra.run.trial127.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 1.9 MB/s | 909 kB 00:00 2026-02-13T03:41:59.799 INFO:teuthology.orchestra.run.trial127.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 2.5 MB/s | 159 kB 00:00 2026-02-13T03:41:59.859 INFO:teuthology.orchestra.run.trial127.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 2.0 MB/s | 123 kB 00:00 2026-02-13T03:41:59.922 INFO:teuthology.orchestra.run.trial127.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 3.8 MB/s | 248 kB 00:00 2026-02-13T03:41:59.970 INFO:teuthology.orchestra.run.trial070.stdout:(65/173): flex-2.6.4-9.el9.x86_64.rpm 392 kB/s | 313 kB 00:00 2026-02-13T03:42:00.028 INFO:teuthology.orchestra.run.trial127.stdout:(21/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 12 MB/s | 13 MB 00:01 2026-02-13T03:42:00.074 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-13T03:42:00.077 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T03:42:00.085 INFO:teuthology.orchestra.run.trial177.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T03:42:00.091 INFO:teuthology.orchestra.run.trial127.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 716 kB/s | 45 kB 00:00 2026-02-13T03:42:00.096 INFO:teuthology.orchestra.run.trial177.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T03:42:00.100 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T03:42:00.102 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T03:42:00.106 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T03:42:00.148 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T03:42:00.153 INFO:teuthology.orchestra.run.trial127.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 2.9 MB/s | 185 kB 00:00 2026-02-13T03:42:00.153 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T03:42:00.186 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:42:00.189 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:42:00.210 INFO:teuthology.orchestra.run.trial127.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 3.5 MB/s | 204 kB 00:00 2026-02-13T03:42:00.256 INFO:teuthology.orchestra.run.trial127.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 6.9 MB/s | 324 kB 00:00 2026-02-13T03:42:00.294 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:42:00.298 INFO:teuthology.orchestra.run.trial177.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T03:42:00.302 INFO:teuthology.orchestra.run.trial127.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 6.5 MB/s | 306 kB 00:00 2026-02-13T03:42:00.331 INFO:teuthology.orchestra.run.trial177.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T03:42:00.353 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T03:42:00.359 INFO:teuthology.orchestra.run.trial127.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 1.7 MB/s | 100 kB 00:00 2026-02-13T03:42:00.364 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T03:42:00.367 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T03:42:00.372 INFO:teuthology.orchestra.run.trial177.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T03:42:00.378 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T03:42:00.380 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T03:42:00.385 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T03:42:00.405 INFO:teuthology.orchestra.run.trial127.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.8 MB/s | 84 kB 00:00 2026-02-13T03:42:00.408 INFO:teuthology.orchestra.run.trial177.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T03:42:00.421 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T03:42:00.427 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T03:42:00.430 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T03:42:00.436 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T03:42:00.438 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T03:42:00.440 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T03:42:00.451 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T03:42:00.452 INFO:teuthology.orchestra.run.trial070.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2026-02-13T03:42:00.485 INFO:teuthology.orchestra.run.trial177.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T03:42:00.490 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T03:42:00.492 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T03:42:00.492 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:42:00.511 INFO:teuthology.orchestra.run.trial127.stdout:(29/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 11 MB/s | 6.5 MB 00:00 2026-02-13T03:42:00.515 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:42:00.521 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T03:42:00.545 INFO:teuthology.orchestra.run.trial177.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T03:42:00.550 INFO:teuthology.orchestra.run.trial177.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T03:42:00.553 INFO:teuthology.orchestra.run.trial177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T03:42:00.556 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T03:42:00.558 INFO:teuthology.orchestra.run.trial177.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T03:42:00.578 INFO:teuthology.orchestra.run.trial127.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 2.5 MB/s | 172 kB 00:00 2026-02-13T03:42:00.586 INFO:teuthology.orchestra.run.trial177.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T03:42:00.635 INFO:teuthology.orchestra.run.trial127.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.0 MB/s | 57 kB 00:00 2026-02-13T03:42:00.638 INFO:teuthology.orchestra.run.trial177.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T03:42:00.651 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T03:42:00.656 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T03:42:00.664 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T03:42:00.665 INFO:teuthology.orchestra.run.trial127.stdout:(32/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 11 MB/s | 2.9 MB 00:00 2026-02-13T03:42:00.682 INFO:teuthology.orchestra.run.trial177.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T03:42:00.688 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T03:42:00.691 INFO:teuthology.orchestra.run.trial127.stdout:(33/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 3.2 MB/s | 183 kB 00:00 2026-02-13T03:42:00.770 INFO:teuthology.orchestra.run.trial070.stdout:(67/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2026-02-13T03:42:00.838 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T03:42:00.842 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:42:00.925 INFO:teuthology.orchestra.run.trial070.stdout:(68/173): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2026-02-13T03:42:00.972 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:42:00.973 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:42:01.020 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:42:01.021 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:42:01.051 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:42:01.053 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T03:42:01.061 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T03:42:01.063 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T03:42:01.123 INFO:teuthology.orchestra.run.trial177.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T03:42:01.138 INFO:teuthology.orchestra.run.trial177.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T03:42:01.145 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T03:42:01.146 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:42:01.168 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:42:01.169 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:42:01.196 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:42:01.204 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T03:42:01.212 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T03:42:01.224 INFO:teuthology.orchestra.run.trial177.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T03:42:01.281 INFO:teuthology.orchestra.run.trial177.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T03:42:01.310 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T03:42:01.316 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T03:42:01.320 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T03:42:01.334 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T03:42:01.339 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T03:42:01.344 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T03:42:01.346 INFO:teuthology.orchestra.run.trial127.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 11 MB/s | 7.4 MB 00:00 2026-02-13T03:42:01.355 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T03:42:01.360 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T03:42:01.368 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T03:42:01.373 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T03:42:01.381 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T03:42:01.401 INFO:teuthology.orchestra.run.trial127.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 5.3 MB/s | 297 kB 00:00 2026-02-13T03:42:01.420 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T03:42:01.444 INFO:teuthology.orchestra.run.trial127.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 1.1 MB/s | 50 kB 00:00 2026-02-13T03:42:01.486 INFO:teuthology.orchestra.run.trial127.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 419 kB/s | 17 kB 00:00 2026-02-13T03:42:01.492 INFO:teuthology.orchestra.run.trial070.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 227 kB/s | 164 kB 00:00 2026-02-13T03:42:01.533 INFO:teuthology.orchestra.run.trial127.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 6.2 MB/s | 299 kB 00:00 2026-02-13T03:42:01.635 INFO:teuthology.orchestra.run.trial127.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 10 MB/s | 1.0 MB 00:00 2026-02-13T03:42:01.654 INFO:teuthology.orchestra.run.trial070.stdout:(70/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 220 kB/s | 160 kB 00:00 2026-02-13T03:42:01.688 INFO:teuthology.orchestra.run.trial127.stdout:(40/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 15 MB/s | 15 MB 00:01 2026-02-13T03:42:01.688 INFO:teuthology.orchestra.run.trial127.stdout:(41/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 341 kB/s | 18 kB 00:00 2026-02-13T03:42:01.745 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T03:42:01.755 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T03:42:01.759 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T03:42:01.765 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T03:42:01.768 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T03:42:01.774 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T03:42:01.776 INFO:teuthology.orchestra.run.trial177.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T03:42:01.777 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T03:42:01.806 INFO:teuthology.orchestra.run.trial177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T03:42:01.849 INFO:teuthology.orchestra.run.trial177.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T03:42:01.853 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T03:42:01.857 INFO:teuthology.orchestra.run.trial177.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T03:42:01.863 INFO:teuthology.orchestra.run.trial177.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T03:42:01.891 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T03:42:01.897 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T03:42:01.901 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T03:42:01.906 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T03:42:01.910 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T03:42:01.917 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T03:42:01.921 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T03:42:01.949 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T03:42:01.958 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T03:42:01.964 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T03:42:01.971 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T03:42:02.006 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:42:02.017 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T03:42:02.079 INFO:teuthology.orchestra.run.trial070.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2026-02-13T03:42:02.240 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T03:42:02.264 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T03:42:02.268 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T03:42:02.326 INFO:teuthology.orchestra.run.trial177.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T03:42:02.328 INFO:teuthology.orchestra.run.trial177.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T03:42:02.349 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T03:42:02.511 INFO:teuthology.orchestra.run.trial127.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 426 kB/s | 350 kB 00:00 2026-02-13T03:42:02.528 INFO:teuthology.orchestra.run.trial070.stdout:(72/173): librdkafka-1.6.1-102.el9.x86_64.rpm 758 kB/s | 662 kB 00:00 2026-02-13T03:42:02.596 INFO:teuthology.orchestra.run.trial127.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 478 kB/s | 40 kB 00:00 2026-02-13T03:42:02.660 INFO:teuthology.orchestra.run.trial127.stdout:(44/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.2 MB/s | 2.1 MB 00:00 2026-02-13T03:42:02.675 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T03:42:02.679 INFO:teuthology.orchestra.run.trial127.stdout:(45/173): libatomic-11.5.0-14.el9.x86_64.rpm 274 kB/s | 23 kB 00:00 2026-02-13T03:42:02.750 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T03:42:02.803 INFO:teuthology.orchestra.run.trial127.stdout:(46/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 21 MB/s | 78 MB 00:03 2026-02-13T03:42:02.804 INFO:teuthology.orchestra.run.trial127.stdout:(47/173): libconfig-1.7.2-9.el9.x86_64.rpm 503 kB/s | 72 kB 00:00 2026-02-13T03:42:02.843 INFO:teuthology.orchestra.run.trial070.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 323 kB/s | 246 kB 00:00 2026-02-13T03:42:02.883 INFO:teuthology.orchestra.run.trial127.stdout:(48/173): libgfortran-11.5.0-14.el9.x86_64.rpm 3.8 MB/s | 794 kB 00:00 2026-02-13T03:42:02.889 INFO:teuthology.orchestra.run.trial127.stdout:(49/173): libquadmath-11.5.0-14.el9.x86_64.rpm 2.1 MB/s | 184 kB 00:00 2026-02-13T03:42:02.970 INFO:teuthology.orchestra.run.trial127.stdout:(50/173): mailcap-2.1.49-5.el9.noarch.rpm 381 kB/s | 33 kB 00:00 2026-02-13T03:42:02.974 INFO:teuthology.orchestra.run.trial127.stdout:(51/173): pciutils-3.7.0-7.el9.x86_64.rpm 1.1 MB/s | 93 kB 00:00 2026-02-13T03:42:03.054 INFO:teuthology.orchestra.run.trial127.stdout:(52/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 253 kB 00:00 2026-02-13T03:42:03.138 INFO:teuthology.orchestra.run.trial127.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-13T03:42:03.139 INFO:teuthology.orchestra.run.trial127.stdout:(54/173): python3-cryptography-36.0.1-5.el9.x86 7.5 MB/s | 1.2 MB 00:00 2026-02-13T03:42:03.221 INFO:teuthology.orchestra.run.trial127.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2026-02-13T03:42:03.223 INFO:teuthology.orchestra.run.trial127.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 1.5 MB/s | 126 kB 00:00 2026-02-13T03:42:03.285 INFO:teuthology.orchestra.run.trial127.stdout:(57/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 195 kB/s | 94 kB 00:00 2026-02-13T03:42:03.306 INFO:teuthology.orchestra.run.trial127.stdout:(58/173): python3-urllib3-1.26.5-7.el9.noarch.r 2.5 MB/s | 218 kB 00:00 2026-02-13T03:42:03.307 INFO:teuthology.orchestra.run.trial127.stdout:(59/173): unzip-6.0-59.el9.x86_64.rpm 2.1 MB/s | 182 kB 00:00 2026-02-13T03:42:03.386 INFO:teuthology.orchestra.run.trial070.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 677 kB/s | 581 kB 00:00 2026-02-13T03:42:03.388 INFO:teuthology.orchestra.run.trial070.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 45 kB/s | 25 kB 00:00 2026-02-13T03:42:03.423 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T03:42:03.437 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T03:42:03.441 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T03:42:03.443 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T03:42:03.447 INFO:teuthology.orchestra.run.trial127.stdout:(60/173): zip-3.0-35.el9.x86_64.rpm 1.6 MB/s | 266 kB 00:00 2026-02-13T03:42:03.449 INFO:teuthology.orchestra.run.trial177.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T03:42:03.506 INFO:teuthology.orchestra.run.trial127.stdout:(61/173): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2026-02-13T03:42:03.518 INFO:teuthology.orchestra.run.trial127.stdout:(62/173): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2026-02-13T03:42:03.533 INFO:teuthology.orchestra.run.trial127.stdout:(63/173): elfutils-libelf-devel-0.194-1.el9.x86 3.0 MB/s | 79 kB 00:00 2026-02-13T03:42:03.537 INFO:teuthology.orchestra.run.trial070.stdout:(76/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 9.8 MB/s | 78 MB 00:07 2026-02-13T03:42:03.547 INFO:teuthology.orchestra.run.trial127.stdout:(64/173): flex-2.6.4-9.el9.x86_64.rpm 10 MB/s | 313 kB 00:00 2026-02-13T03:42:03.558 INFO:teuthology.orchestra.run.trial127.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 1.3 MB/s | 33 kB 00:00 2026-02-13T03:42:03.571 INFO:teuthology.orchestra.run.trial127.stdout:(66/173): boost-program-options-1.75.0-13.el9.x 840 kB/s | 104 kB 00:00 2026-02-13T03:42:03.585 INFO:teuthology.orchestra.run.trial127.stdout:(67/173): flexiblas-openblas-openmp-3.0.4-8.el9 677 kB/s | 18 kB 00:00 2026-02-13T03:42:03.597 INFO:teuthology.orchestra.run.trial127.stdout:(68/173): libaio-devel-0.3.111-13.el9.x86_64.rp 431 kB/s | 11 kB 00:00 2026-02-13T03:42:03.613 INFO:teuthology.orchestra.run.trial127.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 5.7 MB/s | 164 kB 00:00 2026-02-13T03:42:03.625 INFO:teuthology.orchestra.run.trial127.stdout:(70/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 38 MB/s | 3.0 MB 00:00 2026-02-13T03:42:03.639 INFO:teuthology.orchestra.run.trial127.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-13T03:42:03.653 INFO:teuthology.orchestra.run.trial127.stdout:(72/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.8 MB/s | 160 kB 00:00 2026-02-13T03:42:03.654 INFO:teuthology.orchestra.run.trial127.stdout:(73/173): librdkafka-1.6.1-102.el9.x86_64.rpm 22 MB/s | 662 kB 00:00 2026-02-13T03:42:03.668 INFO:teuthology.orchestra.run.trial127.stdout:(74/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 8.0 MB/s | 246 kB 00:00 2026-02-13T03:42:03.679 INFO:teuthology.orchestra.run.trial127.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 979 kB/s | 25 kB 00:00 2026-02-13T03:42:03.698 INFO:teuthology.orchestra.run.trial127.stdout:(76/173): libxslt-1.1.34-12.el9.x86_64.rpm 7.8 MB/s | 233 kB 00:00 2026-02-13T03:42:03.705 INFO:teuthology.orchestra.run.trial127.stdout:(77/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 2.0 MB/s | 51 kB 00:00 2026-02-13T03:42:03.721 INFO:teuthology.orchestra.run.trial127.stdout:(78/173): libtool-2.4.6-46.el9.x86_64.rpm 8.3 MB/s | 581 kB 00:00 2026-02-13T03:42:03.728 INFO:teuthology.orchestra.run.trial177.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T03:42:03.729 INFO:teuthology.orchestra.run.trial127.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.1 MB/s | 292 kB 00:00 2026-02-13T03:42:03.729 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:42:03.731 INFO:teuthology.orchestra.run.trial127.stdout:(80/173): lua-5.4.4-4.el9.x86_64.rpm 7.1 MB/s | 188 kB 00:00 2026-02-13T03:42:03.746 INFO:teuthology.orchestra.run.trial127.stdout:(81/173): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-13T03:42:03.749 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:42:03.750 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T03:42:03.772 INFO:teuthology.orchestra.run.trial127.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 891 kB/s | 22 kB 00:00 2026-02-13T03:42:03.797 INFO:teuthology.orchestra.run.trial127.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2026-02-13T03:42:03.811 INFO:teuthology.orchestra.run.trial127.stdout:(84/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 60 MB/s | 4.8 MB 00:00 2026-02-13T03:42:03.822 INFO:teuthology.orchestra.run.trial127.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 1.7 MB/s | 45 kB 00:00 2026-02-13T03:42:03.835 INFO:teuthology.orchestra.run.trial127.stdout:(86/173): openblas-openmp-0.3.29-1.el9.x86_64.r 50 MB/s | 5.3 MB 00:00 2026-02-13T03:42:03.864 INFO:teuthology.orchestra.run.trial127.stdout:(87/173): postgresql-private-libs-13.23-1.el9.x 4.7 MB/s | 138 kB 00:00 2026-02-13T03:42:03.867 INFO:teuthology.orchestra.run.trial127.stdout:(88/173): postgresql-13.23-1.el9.x86_64.rpm 29 MB/s | 1.6 MB 00:00 2026-02-13T03:42:03.875 INFO:teuthology.orchestra.run.trial127.stdout:(89/173): postgresql-contrib-13.23-1.el9.x86_64 17 MB/s | 903 kB 00:00 2026-02-13T03:42:03.898 INFO:teuthology.orchestra.run.trial127.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 33 MB/s | 1.0 MB 00:00 2026-02-13T03:42:03.924 INFO:teuthology.orchestra.run.trial127.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 2.3 MB/s | 61 kB 00:00 2026-02-13T03:42:03.931 INFO:teuthology.orchestra.run.trial127.stdout:(92/173): postgresql-server-13.23-1.el9.x86_64. 87 MB/s | 5.8 MB 00:00 2026-02-13T03:42:03.953 INFO:teuthology.orchestra.run.trial127.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 8.4 MB/s | 244 kB 00:00 2026-02-13T03:42:03.958 INFO:teuthology.orchestra.run.trial127.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 9.0 MB/s | 249 kB 00:00 2026-02-13T03:42:03.975 INFO:teuthology.orchestra.run.trial127.stdout:(95/173): python3-babel-2.9.1-2.el9.noarch.rpm 59 MB/s | 6.0 MB 00:00 2026-02-13T03:42:03.979 INFO:teuthology.orchestra.run.trial127.stdout:(96/173): python3-jmespath-1.0.1-1.el9.noarch.r 1.8 MB/s | 48 kB 00:00 2026-02-13T03:42:03.986 INFO:teuthology.orchestra.run.trial127.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 6.3 MB/s | 177 kB 00:00 2026-02-13T03:42:04.001 INFO:teuthology.orchestra.run.trial127.stdout:(98/173): python3-markupsafe-1.1.1-12.el9.x86_6 1.3 MB/s | 35 kB 00:00 2026-02-13T03:42:04.015 INFO:teuthology.orchestra.run.trial127.stdout:(99/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 15 MB/s | 442 kB 00:00 2026-02-13T03:42:04.027 INFO:teuthology.orchestra.run.trial127.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 2.9 MB/s | 77 kB 00:00 2026-02-13T03:42:04.046 INFO:teuthology.orchestra.run.trial127.stdout:(101/173): python3-numpy-1.23.5-2.el9.x86_64.rp 91 MB/s | 6.1 MB 00:00 2026-02-13T03:42:04.047 INFO:teuthology.orchestra.run.trial127.stdout:(102/173): python3-protobuf-3.14.0-17.el9.noarc 8.1 MB/s | 267 kB 00:00 2026-02-13T03:42:04.053 INFO:teuthology.orchestra.run.trial127.stdout:(103/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 6.0 MB/s | 159 kB 00:00 2026-02-13T03:42:04.059 INFO:teuthology.orchestra.run.trial070.stdout:(77/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 76 kB/s | 51 kB 00:00 2026-02-13T03:42:04.075 INFO:teuthology.orchestra.run.trial127.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 9.5 MB/s | 279 kB 00:00 2026-02-13T03:42:04.075 INFO:teuthology.orchestra.run.trial127.stdout:(105/173): python3-requests-oauthlib-1.3.0-12.e 1.9 MB/s | 54 kB 00:00 2026-02-13T03:42:04.100 INFO:teuthology.orchestra.run.trial127.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-13T03:42:04.101 INFO:teuthology.orchestra.run.trial127.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 1.6 MB/s | 44 kB 00:00 2026-02-13T03:42:04.127 INFO:teuthology.orchestra.run.trial127.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 8.8 MB/s | 240 kB 00:00 2026-02-13T03:42:04.128 INFO:teuthology.orchestra.run.trial127.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 1.4 MB/s | 37 kB 00:00 2026-02-13T03:42:04.154 INFO:teuthology.orchestra.run.trial127.stdout:(110/173): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-13T03:42:04.159 INFO:teuthology.orchestra.run.trial127.stdout:(111/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.0 MB/s | 66 kB 00:00 2026-02-13T03:42:04.180 INFO:teuthology.orchestra.run.trial127.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2026-02-13T03:42:04.185 INFO:teuthology.orchestra.run.trial127.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 3.6 MB/s | 96 kB 00:00 2026-02-13T03:42:04.206 INFO:teuthology.orchestra.run.trial127.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-13T03:42:04.211 INFO:teuthology.orchestra.run.trial127.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-13T03:42:04.216 INFO:teuthology.orchestra.run.trial070.stdout:(78/173): libxslt-1.1.34-12.el9.x86_64.rpm 281 kB/s | 233 kB 00:00 2026-02-13T03:42:04.220 INFO:teuthology.orchestra.run.trial127.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 22 kB 00:00 2026-02-13T03:42:04.250 INFO:teuthology.orchestra.run.trial127.stdout:(117/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 98 MB/s | 19 MB 00:00 2026-02-13T03:42:04.259 INFO:teuthology.orchestra.run.trial127.stdout:(118/173): protobuf-compiler-3.14.0-17.el9.x86_ 18 MB/s | 862 kB 00:00 2026-02-13T03:42:04.313 INFO:teuthology.orchestra.run.trial127.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 362 kB/s | 19 kB 00:00 2026-02-13T03:42:04.319 INFO:teuthology.orchestra.run.trial127.stdout:(120/173): abseil-cpp-20211102.0-4.el9.x86_64.r 5.5 MB/s | 551 kB 00:00 2026-02-13T03:42:04.319 INFO:teuthology.orchestra.run.trial127.stdout:(121/173): gperftools-libs-2.9.1-3.el9.x86_64.r 4.4 MB/s | 308 kB 00:00 2026-02-13T03:42:04.332 INFO:teuthology.orchestra.run.trial070.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 368 kB/s | 292 kB 00:00 2026-02-13T03:42:04.334 INFO:teuthology.orchestra.run.trial127.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.6 MB/s | 25 kB 00:00 2026-02-13T03:42:04.345 INFO:teuthology.orchestra.run.trial127.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2026-02-13T03:42:04.348 INFO:teuthology.orchestra.run.trial127.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 4.7 MB/s | 67 kB 00:00 2026-02-13T03:42:04.359 INFO:teuthology.orchestra.run.trial127.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 10 MB/s | 151 kB 00:00 2026-02-13T03:42:04.384 INFO:teuthology.orchestra.run.trial127.stdout:(126/173): python3-asyncssh-2.13.2-5.el9.noarch 22 MB/s | 548 kB 00:00 2026-02-13T03:42:04.390 INFO:teuthology.orchestra.run.trial127.stdout:(127/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 19 MB/s | 838 kB 00:00 2026-02-13T03:42:04.401 INFO:teuthology.orchestra.run.trial127.stdout:(128/173): python3-autocommand-2.2.2-8.el9.noar 1.6 MB/s | 29 kB 00:00 2026-02-13T03:42:04.409 INFO:teuthology.orchestra.run.trial127.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 3.1 MB/s | 60 kB 00:00 2026-02-13T03:42:04.414 INFO:teuthology.orchestra.run.trial127.stdout:(130/173): libarrow-9.0.0-15.el9.x86_64.rpm 43 MB/s | 4.4 MB 00:00 2026-02-13T03:42:04.421 INFO:teuthology.orchestra.run.trial127.stdout:(131/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.2 MB/s | 43 kB 00:00 2026-02-13T03:42:04.427 INFO:teuthology.orchestra.run.trial127.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 1.8 MB/s | 32 kB 00:00 2026-02-13T03:42:04.432 INFO:teuthology.orchestra.run.trial127.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 814 kB/s | 14 kB 00:00 2026-02-13T03:42:04.440 INFO:teuthology.orchestra.run.trial127.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 9.0 MB/s | 173 kB 00:00 2026-02-13T03:42:04.446 INFO:teuthology.orchestra.run.trial127.stdout:(135/173): python3-cherrypy-18.6.1-2.el9.noarch 19 MB/s | 358 kB 00:00 2026-02-13T03:42:04.458 INFO:teuthology.orchestra.run.trial127.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 14 MB/s | 254 kB 00:00 2026-02-13T03:42:04.472 INFO:teuthology.orchestra.run.trial127.stdout:(137/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.3 MB/s | 303 kB 00:00 2026-02-13T03:42:04.476 INFO:teuthology.orchestra.run.trial127.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 7.8 MB/s | 144 kB 00:00 2026-02-13T03:42:04.480 INFO:teuthology.orchestra.run.trial127.stdout:(139/173): python3-grpcio-1.46.7-10.el9.x86_64. 59 MB/s | 2.0 MB 00:00 2026-02-13T03:42:04.490 INFO:teuthology.orchestra.run.trial127.stdout:(140/173): python3-jaraco-8.2.1-3.el9.noarch.rp 614 kB/s | 11 kB 00:00 2026-02-13T03:42:04.494 INFO:teuthology.orchestra.run.trial127.stdout:(141/173): python3-jaraco-classes-3.2.1-5.el9.n 984 kB/s | 18 kB 00:00 2026-02-13T03:42:04.498 INFO:teuthology.orchestra.run.trial127.stdout:(142/173): python3-jaraco-collections-3.0.0-8.e 1.3 MB/s | 23 kB 00:00 2026-02-13T03:42:04.507 INFO:teuthology.orchestra.run.trial127.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 1.1 MB/s | 20 kB 00:00 2026-02-13T03:42:04.512 INFO:teuthology.orchestra.run.trial127.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2026-02-13T03:42:04.516 INFO:teuthology.orchestra.run.trial127.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 1.5 MB/s | 26 kB 00:00 2026-02-13T03:42:04.530 INFO:teuthology.orchestra.run.trial127.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 4.3 MB/s | 79 kB 00:00 2026-02-13T03:42:04.536 INFO:teuthology.orchestra.run.trial127.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 2.8 MB/s | 58 kB 00:00 2026-02-13T03:42:04.538 INFO:teuthology.orchestra.run.trial127.stdout:(148/173): python3-kubernetes-26.1.0-3.el9.noar 33 MB/s | 1.0 MB 00:00 2026-02-13T03:42:04.548 INFO:teuthology.orchestra.run.trial127.stdout:(149/173): python3-portend-3.1.0-2.el9.noarch.r 928 kB/s | 16 kB 00:00 2026-02-13T03:42:04.554 INFO:teuthology.orchestra.run.trial127.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 4.8 MB/s | 90 kB 00:00 2026-02-13T03:42:04.556 INFO:teuthology.orchestra.run.trial127.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 1.6 MB/s | 28 kB 00:00 2026-02-13T03:42:04.566 INFO:teuthology.orchestra.run.trial127.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 1.7 MB/s | 31 kB 00:00 2026-02-13T03:42:04.573 INFO:teuthology.orchestra.run.trial127.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 9.5 MB/s | 188 kB 00:00 2026-02-13T03:42:04.574 INFO:teuthology.orchestra.run.trial127.stdout:(154/173): python3-rsa-4.9-2.el9.noarch.rpm 3.2 MB/s | 59 kB 00:00 2026-02-13T03:42:04.584 INFO:teuthology.orchestra.run.trial127.stdout:(155/173): python3-tempora-5.0.0-2.el9.noarch.r 1.9 MB/s | 36 kB 00:00 2026-02-13T03:42:04.593 INFO:teuthology.orchestra.run.trial127.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 4.4 MB/s | 86 kB 00:00 2026-02-13T03:42:04.594 INFO:teuthology.orchestra.run.trial127.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 4.5 MB/s | 90 kB 00:00 2026-02-13T03:42:04.602 INFO:teuthology.orchestra.run.trial127.stdout:(158/173): python3-xmltodict-0.12.0-15.el9.noar 1.2 MB/s | 22 kB 00:00 2026-02-13T03:42:04.610 INFO:teuthology.orchestra.run.trial127.stdout:(159/173): re2-20211101-20.el9.x86_64.rpm 12 MB/s | 191 kB 00:00 2026-02-13T03:42:04.611 INFO:teuthology.orchestra.run.trial127.stdout:(160/173): python3-zc-lockfile-2.0-10.el9.noarc 1.1 MB/s | 20 kB 00:00 2026-02-13T03:42:04.627 INFO:teuthology.orchestra.run.trial127.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 7.2 MB/s | 122 kB 00:00 2026-02-13T03:42:04.636 INFO:teuthology.orchestra.run.trial127.stdout:(162/173): thrift-0.15.0-4.el9.x86_64.rpm 47 MB/s | 1.6 MB 00:00 2026-02-13T03:42:04.797 INFO:teuthology.orchestra.run.trial070.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 72 kB/s | 42 kB 00:00 2026-02-13T03:42:04.798 INFO:teuthology.orchestra.run.trial070.stdout:(81/173): lua-5.4.4-4.el9.x86_64.rpm 255 kB/s | 188 kB 00:00 2026-02-13T03:42:04.803 INFO:teuthology.orchestra.run.trial127.stdout:(163/173): librados2-20.3.0-5241.g8f8d3829.el9. 18 MB/s | 3.5 MB 00:00 2026-02-13T03:42:04.811 INFO:teuthology.orchestra.run.trial127.stdout:(164/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 15 MB/s | 2.8 MB 00:00 2026-02-13T03:42:04.841 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:42:04.843 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:42:04.863 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:42:04.876 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T03:42:04.892 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T03:42:04.968 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T03:42:04.976 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T03:42:05.000 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T03:42:05.030 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T03:42:05.080 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T03:42:05.086 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T03:42:05.090 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T03:42:05.094 INFO:teuthology.orchestra.run.trial177.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T03:42:05.097 INFO:teuthology.orchestra.run.trial177.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T03:42:05.097 INFO:teuthology.orchestra.run.trial177.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:42:05.114 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:42:05.215 INFO:teuthology.orchestra.run.trial127.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 92 kB/s | 37 kB 00:00 2026-02-13T03:42:05.336 INFO:teuthology.orchestra.run.trial070.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 41 kB/s | 22 kB 00:00 2026-02-13T03:42:05.362 INFO:teuthology.orchestra.run.trial177.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T03:42:05.365 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:42:05.406 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:42:05.406 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T03:42:05.406 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T03:42:05.406 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:05.409 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:42:05.438 INFO:teuthology.orchestra.run.trial070.stdout:(83/173): openblas-openmp-0.3.29-1.el9.x86_64.r 4.8 MB/s | 5.3 MB 00:01 2026-02-13T03:42:05.535 INFO:teuthology.orchestra.run.trial127.stdout:(166/173): NetworkManager-tui-1.54.3-2.el9.x86_ 774 kB/s | 248 kB 00:00 2026-02-13T03:42:05.839 INFO:teuthology.orchestra.run.trial127.stdout:(167/173): NetworkManager-1.54.3-2.el9.x86_64.r 2.0 MB/s | 2.4 MB 00:01 2026-02-13T03:42:05.898 INFO:teuthology.orchestra.run.trial070.stdout:(84/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 4.4 MB/s | 4.8 MB 00:01 2026-02-13T03:42:05.947 INFO:teuthology.orchestra.run.trial070.stdout:(85/173): perl-threads-2.25-460.el9.x86_64.rpm 96 kB/s | 58 kB 00:00 2026-02-13T03:42:06.003 INFO:teuthology.orchestra.run.trial127.stdout:(168/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 2.7 MB/s | 454 kB 00:00 2026-02-13T03:42:06.019 INFO:teuthology.orchestra.run.trial070.stdout:(86/173): perl-threads-shared-1.61-460.el9.x86_ 77 kB/s | 45 kB 00:00 2026-02-13T03:42:06.490 INFO:teuthology.orchestra.run.trial127.stdout:(169/173): openssl-3.5.5-1.el9.x86_64.rpm 3.0 MB/s | 1.5 MB 00:00 2026-02-13T03:42:06.564 INFO:teuthology.orchestra.run.trial127.stdout:(170/173): iproute-6.17.0-2.el9.x86_64.rpm 842 kB/s | 866 kB 00:01 2026-02-13T03:42:06.724 INFO:teuthology.orchestra.run.trial070.stdout:(87/173): postgresql-private-libs-13.23-1.el9.x 196 kB/s | 138 kB 00:00 2026-02-13T03:42:06.733 INFO:teuthology.orchestra.run.trial127.stdout:(171/173): openssl-fips-provider-3.5.5-1.el9.x8 3.3 MB/s | 814 kB 00:00 2026-02-13T03:42:06.859 INFO:teuthology.orchestra.run.trial070.stdout:(88/173): postgresql-contrib-13.23-1.el9.x86_64 990 kB/s | 903 kB 00:00 2026-02-13T03:42:06.872 INFO:teuthology.orchestra.run.trial070.stdout:(89/173): postgresql-13.23-1.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2026-02-13T03:42:07.415 INFO:teuthology.orchestra.run.trial127.stdout:(172/173): NetworkManager-libnm-1.54.3-2.el9.x8 746 kB/s | 1.9 MB 00:02 2026-02-13T03:42:07.782 INFO:teuthology.orchestra.run.trial070.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2026-02-13T03:42:07.846 INFO:teuthology.orchestra.run.trial070.stdout:(91/173): postgresql-server-13.23-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2026-02-13T03:42:07.992 INFO:teuthology.orchestra.run.trial070.stdout:(92/173): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2026-02-13T03:42:08.403 INFO:teuthology.orchestra.run.trial070.stdout:(93/173): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2026-02-13T03:42:08.611 INFO:teuthology.orchestra.run.trial070.stdout:(94/173): python3-devel-3.9.25-2.el9.x86_64.rpm 319 kB/s | 244 kB 00:00 2026-02-13T03:42:08.756 INFO:teuthology.orchestra.run.trial070.stdout:(95/173): python3-jinja2-2.11.3-8.el9.noarch.rp 326 kB/s | 249 kB 00:00 2026-02-13T03:42:08.991 INFO:teuthology.orchestra.run.trial070.stdout:(96/173): python3-jmespath-1.0.1-1.el9.noarch.r 81 kB/s | 48 kB 00:00 2026-02-13T03:42:09.245 INFO:teuthology.orchestra.run.trial127.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 880 kB/s | 2.3 MB 00:02 2026-02-13T03:42:09.252 INFO:teuthology.orchestra.run.trial127.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:42:09.252 INFO:teuthology.orchestra.run.trial127.stdout:Total 24 MB/s | 302 MB 00:12 2026-02-13T03:42:09.323 INFO:teuthology.orchestra.run.trial070.stdout:(97/173): python3-markupsafe-1.1.1-12.el9.x86_6 61 kB/s | 35 kB 00:00 2026-02-13T03:42:09.341 INFO:teuthology.orchestra.run.trial070.stdout:(98/173): python3-libstoragemgmt-1.10.1-1.el9.x 242 kB/s | 177 kB 00:00 2026-02-13T03:42:09.976 INFO:teuthology.orchestra.run.trial070.stdout:(99/173): python3-packaging-20.9-5.el9.noarch.r 121 kB/s | 77 kB 00:00 2026-02-13T03:42:10.048 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction check 2026-02-13T03:42:10.082 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:42:10.082 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /sys 2026-02-13T03:42:10.082 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /proc 2026-02-13T03:42:10.082 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /mnt 2026-02-13T03:42:10.082 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /var/tmp 2026-02-13T03:42:10.082 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /home 2026-02-13T03:42:10.082 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /root 2026-02-13T03:42:10.083 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /tmp 2026-02-13T03:42:10.083 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:10.115 INFO:teuthology.orchestra.run.trial070.stdout:(100/173): python3-numpy-1.23.5-2.el9.x86_64.rp 5.5 MB/s | 6.1 MB 00:01 2026-02-13T03:42:10.118 INFO:teuthology.orchestra.run.trial127.stdout:Transaction check succeeded. 2026-02-13T03:42:10.119 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction test 2026-02-13T03:42:10.150 INFO:teuthology.orchestra.run.trial070.stdout:(101/173): python3-numpy-f2py-1.23.5-2.el9.x86_ 534 kB/s | 442 kB 00:00 2026-02-13T03:42:10.185 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:42:10.207 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:42:10.207 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:10.207 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T03:42:10.208 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:42:10.208 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:42:10.208 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:10.422 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:42:10.443 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:42:10.443 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:10.443 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T03:42:10.443 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:42:10.443 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:42:10.443 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:10.450 INFO:teuthology.orchestra.run.trial177.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T03:42:10.452 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T03:42:10.470 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:42:10.470 INFO:teuthology.orchestra.run.trial177.stdout:Creating group 'qat' with GID 992. 2026-02-13T03:42:10.470 INFO:teuthology.orchestra.run.trial177.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T03:42:10.470 INFO:teuthology.orchestra.run.trial177.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T03:42:10.470 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:10.478 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:42:10.502 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:42:10.502 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T03:42:10.502 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:10.538 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T03:42:10.751 INFO:teuthology.orchestra.run.trial070.stdout:(102/173): python3-protobuf-3.14.0-17.el9.noarc 345 kB/s | 267 kB 00:00 2026-02-13T03:42:10.830 INFO:teuthology.orchestra.run.trial070.stdout:(103/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 222 kB/s | 159 kB 00:00 2026-02-13T03:42:10.926 INFO:teuthology.orchestra.run.trial070.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 359 kB/s | 279 kB 00:00 2026-02-13T03:42:11.158 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T03:42:11.206 INFO:teuthology.orchestra.run.trial127.stdout:Transaction test succeeded. 2026-02-13T03:42:11.206 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction 2026-02-13T03:42:11.354 INFO:teuthology.orchestra.run.trial070.stdout:(105/173): python3-requests-oauthlib-1.3.0-12.e 89 kB/s | 54 kB 00:00 2026-02-13T03:42:11.502 INFO:teuthology.orchestra.run.trial070.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2026-02-13T03:42:11.914 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T03:42:11.935 INFO:teuthology.orchestra.run.trial070.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 76 kB/s | 44 kB 00:00 2026-02-13T03:42:11.977 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T03:42:11.979 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:42:11.993 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:42:11.994 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:11.994 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T03:42:11.994 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:12.004 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:42:12.028 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:42:12.028 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:12.028 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T03:42:12.028 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:42:12.028 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:42:12.028 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:12.088 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:42:12.090 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:42:12.099 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T03:42:12.123 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T03:42:12.124 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:42:12.240 INFO:teuthology.orchestra.run.trial070.stdout:(108/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 14 MB/s | 19 MB 00:01 2026-02-13T03:42:12.261 INFO:teuthology.orchestra.run.trial070.stdout:(109/173): qatlib-25.08.0-2.el9.x86_64.rpm 316 kB/s | 240 kB 00:00 2026-02-13T03:42:12.378 INFO:teuthology.orchestra.run.trial127.stdout: Preparing : 1/1 2026-02-13T03:42:12.381 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T03:42:12.391 INFO:teuthology.orchestra.run.trial127.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T03:42:12.403 INFO:teuthology.orchestra.run.trial127.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T03:42:12.407 INFO:teuthology.orchestra.run.trial127.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T03:42:12.408 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T03:42:12.413 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T03:42:12.455 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T03:42:12.461 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T03:42:12.495 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:42:12.498 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:42:12.503 INFO:teuthology.orchestra.run.trial070.stdout:(110/173): qatlib-service-25.08.0-2.el9.x86_64. 65 kB/s | 37 kB 00:00 2026-02-13T03:42:12.601 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:42:12.604 INFO:teuthology.orchestra.run.trial127.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T03:42:12.635 INFO:teuthology.orchestra.run.trial127.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T03:42:12.657 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T03:42:12.667 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T03:42:12.673 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T03:42:12.679 INFO:teuthology.orchestra.run.trial127.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T03:42:12.684 INFO:teuthology.orchestra.run.trial127.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T03:42:12.687 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T03:42:12.691 INFO:teuthology.orchestra.run.trial127.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T03:42:12.715 INFO:teuthology.orchestra.run.trial127.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T03:42:12.727 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T03:42:12.734 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T03:42:12.737 INFO:teuthology.orchestra.run.trial127.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T03:42:12.743 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T03:42:12.745 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T03:42:12.746 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T03:42:12.756 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T03:42:12.791 INFO:teuthology.orchestra.run.trial127.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T03:42:12.796 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T03:42:12.798 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T03:42:12.798 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:42:12.820 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:42:12.827 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T03:42:12.851 INFO:teuthology.orchestra.run.trial127.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T03:42:12.855 INFO:teuthology.orchestra.run.trial127.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T03:42:12.858 INFO:teuthology.orchestra.run.trial127.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T03:42:12.860 INFO:teuthology.orchestra.run.trial127.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T03:42:12.863 INFO:teuthology.orchestra.run.trial127.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T03:42:12.871 INFO:teuthology.orchestra.run.trial070.stdout:(111/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 105 kB/s | 66 kB 00:00 2026-02-13T03:42:12.892 INFO:teuthology.orchestra.run.trial127.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T03:42:12.944 INFO:teuthology.orchestra.run.trial127.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T03:42:12.957 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T03:42:12.962 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T03:42:12.970 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T03:42:12.987 INFO:teuthology.orchestra.run.trial127.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T03:42:12.993 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T03:42:13.047 INFO:teuthology.orchestra.run.trial070.stdout:(112/173): socat-1.7.4.1-8.el9.x86_64.rpm 386 kB/s | 303 kB 00:00 2026-02-13T03:42:13.111 INFO:teuthology.orchestra.run.trial070.stdout:(113/173): uuid-1.6.2-55.el9.x86_64.rpm 95 kB/s | 58 kB 00:00 2026-02-13T03:42:13.147 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T03:42:13.152 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:42:13.286 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:42:13.287 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:42:13.335 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:42:13.336 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:42:13.365 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:42:13.367 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T03:42:13.374 INFO:teuthology.orchestra.run.trial127.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T03:42:13.377 INFO:teuthology.orchestra.run.trial127.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T03:42:13.438 INFO:teuthology.orchestra.run.trial127.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T03:42:13.451 INFO:teuthology.orchestra.run.trial127.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T03:42:13.459 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T03:42:13.460 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:42:13.481 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:42:13.482 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:42:13.508 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:42:13.515 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T03:42:13.524 INFO:teuthology.orchestra.run.trial127.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T03:42:13.533 INFO:teuthology.orchestra.run.trial070.stdout:(114/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 145 kB/s | 96 kB 00:00 2026-02-13T03:42:13.536 INFO:teuthology.orchestra.run.trial127.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T03:42:13.562 INFO:teuthology.orchestra.run.trial070.stdout:(115/173): lua-devel-5.4.4-4.el9.x86_64.rpm 790 kB/s | 22 kB 00:00 2026-02-13T03:42:13.593 INFO:teuthology.orchestra.run.trial127.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T03:42:13.603 INFO:teuthology.orchestra.run.trial070.stdout:(116/173): protobuf-compiler-3.14.0-17.el9.x86_ 21 MB/s | 862 kB 00:00 2026-02-13T03:42:13.624 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T03:42:13.630 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T03:42:13.633 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T03:42:13.648 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T03:42:13.652 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T03:42:13.658 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T03:42:13.668 INFO:teuthology.orchestra.run.trial070.stdout:(117/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2026-02-13T03:42:13.669 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T03:42:13.674 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T03:42:13.683 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T03:42:13.684 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:42:13.687 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T03:42:13.691 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:42:13.692 INFO:teuthology.orchestra.run.trial070.stdout:(118/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2026-02-13T03:42:13.695 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T03:42:13.735 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T03:42:13.847 INFO:teuthology.orchestra.run.trial070.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 125 kB/s | 19 kB 00:00 2026-02-13T03:42:13.932 INFO:teuthology.orchestra.run.trial070.stdout:(120/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.6 MB/s | 551 kB 00:00 2026-02-13T03:42:13.965 INFO:teuthology.orchestra.run.trial070.stdout:(121/173): gperftools-libs-2.9.1-3.el9.x86_64.r 1.0 MB/s | 308 kB 00:00 2026-02-13T03:42:13.977 INFO:teuthology.orchestra.run.trial070.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 546 kB/s | 25 kB 00:00 2026-02-13T03:42:14.012 INFO:teuthology.orchestra.run.trial070.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2026-02-13T03:42:14.017 INFO:teuthology.orchestra.run.trial070.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2026-02-13T03:42:14.064 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T03:42:14.073 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T03:42:14.078 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T03:42:14.081 INFO:teuthology.orchestra.run.trial070.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2026-02-13T03:42:14.083 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T03:42:14.087 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T03:42:14.092 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T03:42:14.095 INFO:teuthology.orchestra.run.trial127.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T03:42:14.096 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T03:42:14.125 INFO:teuthology.orchestra.run.trial127.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T03:42:14.131 INFO:teuthology.orchestra.run.trial070.stdout:(126/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.2 MB/s | 838 kB 00:00 2026-02-13T03:42:14.145 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:42:14.146 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:42:14.168 INFO:teuthology.orchestra.run.trial127.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T03:42:14.172 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T03:42:14.176 INFO:teuthology.orchestra.run.trial127.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T03:42:14.179 INFO:teuthology.orchestra.run.trial070.stdout:(127/173): libarrow-9.0.0-15.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2026-02-13T03:42:14.183 INFO:teuthology.orchestra.run.trial127.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T03:42:14.183 INFO:teuthology.orchestra.run.trial070.stdout:(128/173): python3-autocommand-2.2.2-8.el9.noar 575 kB/s | 29 kB 00:00 2026-02-13T03:42:14.197 INFO:teuthology.orchestra.run.trial070.stdout:(129/173): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2026-02-13T03:42:14.207 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:42:14.210 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T03:42:14.218 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T03:42:14.221 INFO:teuthology.orchestra.run.trial070.stdout:(130/173): python3-backports-tarfile-1.2.0-1.el 1.4 MB/s | 60 kB 00:00 2026-02-13T03:42:14.221 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T03:42:14.228 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T03:42:14.228 INFO:teuthology.orchestra.run.trial070.stdout:(131/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 959 kB/s | 43 kB 00:00 2026-02-13T03:42:14.232 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T03:42:14.238 INFO:teuthology.orchestra.run.trial070.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 799 kB/s | 32 kB 00:00 2026-02-13T03:42:14.239 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T03:42:14.242 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T03:42:14.249 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T03:42:14.250 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:42:14.269 INFO:teuthology.orchestra.run.trial070.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 290 kB/s | 14 kB 00:00 2026-02-13T03:42:14.270 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T03:42:14.271 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:42:14.271 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:14.271 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T03:42:14.271 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:42:14.271 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:42:14.271 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:14.280 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T03:42:14.281 INFO:teuthology.orchestra.run.trial070.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 3.3 MB/s | 173 kB 00:00 2026-02-13T03:42:14.282 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:42:14.286 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T03:42:14.292 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:42:14.293 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T03:42:14.305 INFO:teuthology.orchestra.run.trial070.stdout:(135/173): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2026-02-13T03:42:14.319 INFO:teuthology.orchestra.run.trial070.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2026-02-13T03:42:14.328 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:42:14.339 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T03:42:14.348 INFO:teuthology.orchestra.run.trial070.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 3.7 MB/s | 254 kB 00:00 2026-02-13T03:42:14.396 INFO:teuthology.orchestra.run.trial070.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 1.8 MB/s | 144 kB 00:00 2026-02-13T03:42:14.413 INFO:teuthology.orchestra.run.trial070.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 164 kB/s | 11 kB 00:00 2026-02-13T03:42:14.434 INFO:teuthology.orchestra.run.trial070.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 468 kB/s | 18 kB 00:00 2026-02-13T03:42:14.439 INFO:teuthology.orchestra.run.trial070.stdout:(141/173): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2026-02-13T03:42:14.451 INFO:teuthology.orchestra.run.trial070.stdout:(142/173): python3-jaraco-collections-3.0.0-8.e 612 kB/s | 23 kB 00:00 2026-02-13T03:42:14.477 INFO:teuthology.orchestra.run.trial070.stdout:(143/173): python3-jaraco-functools-3.5.0-2.el9 514 kB/s | 19 kB 00:00 2026-02-13T03:42:14.483 INFO:teuthology.orchestra.run.trial070.stdout:(144/173): python3-jaraco-context-6.0.1-3.el9.n 406 kB/s | 20 kB 00:00 2026-02-13T03:42:14.506 INFO:teuthology.orchestra.run.trial070.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 484 kB/s | 26 kB 00:00 2026-02-13T03:42:14.538 INFO:teuthology.orchestra.run.trial070.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 1.4 MB/s | 79 kB 00:00 2026-02-13T03:42:14.553 INFO:teuthology.orchestra.run.trial070.stdout:(147/173): python3-kubernetes-26.1.0-3.el9.noar 13 MB/s | 1.0 MB 00:00 2026-02-13T03:42:14.553 INFO:teuthology.orchestra.run.trial070.stdout:(148/173): python3-natsort-7.1.1-5.el9.noarch.r 1.2 MB/s | 58 kB 00:00 2026-02-13T03:42:14.564 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T03:42:14.581 INFO:teuthology.orchestra.run.trial070.stdout:(149/173): python3-portend-3.1.0-2.el9.noarch.r 376 kB/s | 16 kB 00:00 2026-02-13T03:42:14.588 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T03:42:14.592 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T03:42:14.603 INFO:teuthology.orchestra.run.trial070.stdout:(150/173): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2026-02-13T03:42:14.614 INFO:teuthology.orchestra.run.trial070.stdout:(151/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.4 MB/s | 90 kB 00:00 2026-02-13T03:42:14.627 INFO:teuthology.orchestra.run.trial070.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 674 kB/s | 31 kB 00:00 2026-02-13T03:42:14.651 INFO:teuthology.orchestra.run.trial127.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T03:42:14.653 INFO:teuthology.orchestra.run.trial070.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 3.8 MB/s | 188 kB 00:00 2026-02-13T03:42:14.653 INFO:teuthology.orchestra.run.trial127.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T03:42:14.657 INFO:teuthology.orchestra.run.trial070.stdout:(154/173): python3-rsa-4.9-2.el9.noarch.rpm 1.3 MB/s | 59 kB 00:00 2026-02-13T03:42:14.674 INFO:teuthology.orchestra.run.trial127.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T03:42:14.674 INFO:teuthology.orchestra.run.trial070.stdout:(155/173): python3-tempora-5.0.0-2.el9.noarch.r 764 kB/s | 36 kB 00:00 2026-02-13T03:42:14.701 INFO:teuthology.orchestra.run.trial070.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 1.8 MB/s | 86 kB 00:00 2026-02-13T03:42:14.712 INFO:teuthology.orchestra.run.trial070.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 1.6 MB/s | 90 kB 00:00 2026-02-13T03:42:14.747 INFO:teuthology.orchestra.run.trial070.stdout:(158/173): python3-xmltodict-0.12.0-15.el9.noar 305 kB/s | 22 kB 00:00 2026-02-13T03:42:14.756 INFO:teuthology.orchestra.run.trial070.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 362 kB/s | 20 kB 00:00 2026-02-13T03:42:14.774 INFO:teuthology.orchestra.run.trial070.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 3.0 MB/s | 191 kB 00:00 2026-02-13T03:42:14.806 INFO:teuthology.orchestra.run.trial070.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2026-02-13T03:42:14.808 INFO:teuthology.orchestra.run.trial070.stdout:(162/173): thrift-0.15.0-4.el9.x86_64.rpm 26 MB/s | 1.6 MB 00:00 2026-02-13T03:42:14.861 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T03:42:14.863 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:42:14.885 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:42:14.885 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:14.886 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T03:42:14.886 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:42:14.886 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:42:14.886 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:14.894 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:42:14.914 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:42:14.915 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:14.915 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T03:42:14.915 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:14.928 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:42:14.950 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:42:14.950 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:14.950 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T03:42:14.950 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:42:14.950 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:42:14.950 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:15.004 INFO:teuthology.orchestra.run.trial127.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T03:42:15.073 INFO:teuthology.orchestra.run.trial177.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:42:15.078 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T03:42:15.095 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:42:15.095 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:15.095 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T03:42:15.095 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:42:15.095 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:42:15.095 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:15.285 INFO:teuthology.orchestra.run.trial070.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 5.0 MB/s | 2.4 MB 00:00 2026-02-13T03:42:15.352 INFO:teuthology.orchestra.run.trial070.stdout:(164/173): NetworkManager-libnm-1.54.3-2.el9.x8 28 MB/s | 1.9 MB 00:00 2026-02-13T03:42:15.535 INFO:teuthology.orchestra.run.trial070.stdout:(165/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 3.9 MB/s | 2.8 MB 00:00 2026-02-13T03:42:15.553 INFO:teuthology.orchestra.run.trial070.stdout:(166/173): librados2-20.3.0-5241.g8f8d3829.el9. 4.5 MB/s | 3.5 MB 00:00 2026-02-13T03:42:15.700 INFO:teuthology.orchestra.run.trial070.stdout:(167/173): iproute-6.17.0-2.el9.x86_64.rpm 5.7 MB/s | 866 kB 00:00 2026-02-13T03:42:15.717 INFO:teuthology.orchestra.run.trial070.stdout:(168/173): NetworkManager-team-1.54.3-2.el9.x86 101 kB/s | 37 kB 00:00 2026-02-13T03:42:15.723 INFO:teuthology.orchestra.run.trial070.stdout:(169/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 20 MB/s | 454 kB 00:00 2026-02-13T03:42:15.746 INFO:teuthology.orchestra.run.trial070.stdout:(170/173): openssl-fips-provider-3.5.5-1.el9.x8 34 MB/s | 814 kB 00:00 2026-02-13T03:42:15.758 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T03:42:15.765 INFO:teuthology.orchestra.run.trial070.stdout:(171/173): openssl-3.5.5-1.el9.x86_64.rpm 31 MB/s | 1.5 MB 00:00 2026-02-13T03:42:15.772 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T03:42:15.776 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T03:42:15.778 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T03:42:15.784 INFO:teuthology.orchestra.run.trial127.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T03:42:15.791 INFO:teuthology.orchestra.run.trial070.stdout:(172/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 51 MB/s | 2.3 MB 00:00 2026-02-13T03:42:15.810 INFO:teuthology.orchestra.run.trial070.stdout:(173/173): NetworkManager-tui-1.54.3-2.el9.x86_ 900 kB/s | 248 kB 00:00 2026-02-13T03:42:15.814 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:42:15.814 INFO:teuthology.orchestra.run.trial070.stdout:Total 12 MB/s | 302 MB 00:24 2026-02-13T03:42:16.072 INFO:teuthology.orchestra.run.trial127.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T03:42:16.073 INFO:teuthology.orchestra.run.trial127.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:42:16.092 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:42:16.093 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T03:42:16.597 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-13T03:42:16.667 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-13T03:42:16.667 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-13T03:42:17.211 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:42:17.213 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:42:17.232 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:42:17.246 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T03:42:17.262 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T03:42:17.338 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T03:42:17.347 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T03:42:17.371 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T03:42:17.401 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T03:42:17.453 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T03:42:17.459 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T03:42:17.462 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T03:42:17.467 INFO:teuthology.orchestra.run.trial127.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T03:42:17.469 INFO:teuthology.orchestra.run.trial127.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T03:42:17.470 INFO:teuthology.orchestra.run.trial127.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:42:17.487 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:42:17.741 INFO:teuthology.orchestra.run.trial127.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T03:42:17.744 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:42:17.765 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-13T03:42:17.765 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-13T03:42:17.781 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:42:17.781 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T03:42:17.781 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T03:42:17.781 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:17.786 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:42:18.510 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T03:42:18.524 INFO:teuthology.orchestra.run.trial177.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T03:42:18.527 INFO:teuthology.orchestra.run.trial177.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T03:42:18.601 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T03:42:18.619 INFO:teuthology.orchestra.run.trial177.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T03:42:18.624 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T03:42:18.625 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T03:42:18.750 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:42:18.753 INFO:teuthology.orchestra.run.trial177.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:42:18.771 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:42:18.775 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T03:42:18.784 INFO:teuthology.orchestra.run.trial177.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T03:42:18.826 INFO:teuthology.orchestra.run.trial177.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:42:18.932 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-13T03:42:18.935 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T03:42:18.943 INFO:teuthology.orchestra.run.trial070.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T03:42:18.954 INFO:teuthology.orchestra.run.trial070.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T03:42:18.958 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T03:42:18.960 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T03:42:18.964 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T03:42:19.004 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T03:42:19.010 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T03:42:19.044 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:42:19.047 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:42:19.148 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:42:19.153 INFO:teuthology.orchestra.run.trial070.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T03:42:19.189 INFO:teuthology.orchestra.run.trial070.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T03:42:19.212 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T03:42:19.223 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T03:42:19.227 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T03:42:19.233 INFO:teuthology.orchestra.run.trial070.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T03:42:19.238 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T03:42:19.241 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T03:42:19.246 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T03:42:19.269 INFO:teuthology.orchestra.run.trial070.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T03:42:19.276 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T03:42:19.282 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T03:42:19.289 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T03:42:19.292 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T03:42:19.298 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T03:42:19.299 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T03:42:19.300 INFO:teuthology.orchestra.run.trial177.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T03:42:19.301 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T03:42:19.302 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T03:42:19.305 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:42:19.307 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T03:42:19.311 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T03:42:19.316 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T03:42:19.343 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T03:42:19.346 INFO:teuthology.orchestra.run.trial177.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T03:42:19.346 INFO:teuthology.orchestra.run.trial070.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T03:42:19.348 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:42:19.351 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T03:42:19.351 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T03:42:19.351 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:42:19.353 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T03:42:19.353 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:42:19.365 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:42:19.365 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:42:19.376 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:42:19.378 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:42:19.380 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T03:42:19.382 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T03:42:19.382 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T03:42:19.383 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T03:42:19.390 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:42:19.390 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:42:19.407 INFO:teuthology.orchestra.run.trial070.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T03:42:19.413 INFO:teuthology.orchestra.run.trial070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T03:42:19.415 INFO:teuthology.orchestra.run.trial070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T03:42:19.418 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T03:42:19.421 INFO:teuthology.orchestra.run.trial070.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T03:42:19.449 INFO:teuthology.orchestra.run.trial070.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T03:42:19.481 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:42:19.484 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T03:42:19.487 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T03:42:19.489 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:42:19.495 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T03:42:19.501 INFO:teuthology.orchestra.run.trial070.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T03:42:19.502 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:42:19.514 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T03:42:19.520 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T03:42:19.528 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:42:19.529 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T03:42:19.546 INFO:teuthology.orchestra.run.trial070.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T03:42:19.552 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T03:42:19.703 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T03:42:19.708 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:42:19.838 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:42:19.840 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:42:19.890 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:42:19.891 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:42:19.920 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:42:19.922 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T03:42:19.930 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T03:42:19.932 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T03:42:19.993 INFO:teuthology.orchestra.run.trial070.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T03:42:20.008 INFO:teuthology.orchestra.run.trial070.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T03:42:20.016 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T03:42:20.017 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:42:20.040 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:42:20.041 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:42:20.067 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:42:20.075 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T03:42:20.083 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T03:42:20.096 INFO:teuthology.orchestra.run.trial070.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T03:42:20.153 INFO:teuthology.orchestra.run.trial070.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T03:42:20.183 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T03:42:20.189 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T03:42:20.192 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T03:42:20.207 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T03:42:20.211 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T03:42:20.217 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T03:42:20.228 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T03:42:20.233 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T03:42:20.242 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T03:42:20.247 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T03:42:20.254 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T03:42:20.295 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T03:42:20.488 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:42:20.488 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T03:42:20.488 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T03:42:20.488 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T03:42:20.488 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T03:42:20.488 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T03:42:20.488 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T03:42:20.489 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T03:42:20.490 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T03:42:20.491 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T03:42:20.492 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T03:42:20.493 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T03:42:20.494 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T03:42:20.495 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T03:42:20.496 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T03:42:20.497 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T03:42:20.498 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T03:42:20.499 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T03:42:20.500 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T03:42:20.501 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T03:42:20.502 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T03:42:20.561 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:42:20.561 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:20.561 INFO:teuthology.orchestra.run.trial177.stdout:Upgraded: 2026-02-13T03:42:20.561 INFO:teuthology.orchestra.run.trial177.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:20.561 INFO:teuthology.orchestra.run.trial177.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:20.561 INFO:teuthology.orchestra.run.trial177.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:20.561 INFO:teuthology.orchestra.run.trial177.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:20.561 INFO:teuthology.orchestra.run.trial177.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T03:42:20.562 INFO:teuthology.orchestra.run.trial177.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.563 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.564 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T03:42:20.565 INFO:teuthology.orchestra.run.trial177.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T03:42:20.566 INFO:teuthology.orchestra.run.trial177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T03:42:20.567 INFO:teuthology.orchestra.run.trial177.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T03:42:20.568 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T03:42:20.569 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T03:42:20.570 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T03:42:20.571 INFO:teuthology.orchestra.run.trial177.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T03:42:20.572 INFO:teuthology.orchestra.run.trial177.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T03:42:20.573 INFO:teuthology.orchestra.run.trial177.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T03:42:20.574 INFO:teuthology.orchestra.run.trial177.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T03:42:20.575 INFO:teuthology.orchestra.run.trial177.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T03:42:20.575 INFO:teuthology.orchestra.run.trial177.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T03:42:20.575 INFO:teuthology.orchestra.run.trial177.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T03:42:20.575 INFO:teuthology.orchestra.run.trial177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T03:42:20.575 INFO:teuthology.orchestra.run.trial177.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T03:42:20.575 INFO:teuthology.orchestra.run.trial177.stdout: zip-3.0-35.el9.x86_64 2026-02-13T03:42:20.575 INFO:teuthology.orchestra.run.trial177.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T03:42:20.575 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:42:20.575 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-13T03:42:20.626 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T03:42:20.636 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T03:42:20.640 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T03:42:20.645 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T03:42:20.650 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T03:42:20.656 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T03:42:20.662 DEBUG:teuthology.parallel:result is None 2026-02-13T03:42:20.662 INFO:teuthology.orchestra.run.trial070.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T03:42:20.662 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T03:42:20.689 INFO:teuthology.orchestra.run.trial070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T03:42:20.732 INFO:teuthology.orchestra.run.trial070.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T03:42:20.736 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T03:42:20.740 INFO:teuthology.orchestra.run.trial070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T03:42:20.746 INFO:teuthology.orchestra.run.trial070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T03:42:20.775 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T03:42:20.781 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T03:42:20.785 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T03:42:20.791 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T03:42:20.794 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T03:42:20.801 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T03:42:20.805 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T03:42:20.833 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T03:42:20.843 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T03:42:20.850 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T03:42:20.856 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T03:42:20.891 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:42:20.902 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T03:42:21.129 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T03:42:21.153 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T03:42:21.157 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T03:42:21.216 INFO:teuthology.orchestra.run.trial070.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T03:42:21.219 INFO:teuthology.orchestra.run.trial070.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T03:42:21.240 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T03:42:21.574 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T03:42:21.648 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T03:42:22.334 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T03:42:22.348 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T03:42:22.352 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T03:42:22.354 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T03:42:22.360 INFO:teuthology.orchestra.run.trial070.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T03:42:22.577 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:42:22.577 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /sys 2026-02-13T03:42:22.577 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /proc 2026-02-13T03:42:22.577 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /mnt 2026-02-13T03:42:22.577 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /var/tmp 2026-02-13T03:42:22.577 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /home 2026-02-13T03:42:22.577 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /root 2026-02-13T03:42:22.578 INFO:teuthology.orchestra.run.trial127.stdout:skipping the directory /tmp 2026-02-13T03:42:22.578 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:22.640 INFO:teuthology.orchestra.run.trial070.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T03:42:22.641 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:42:22.660 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:42:22.661 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T03:42:22.679 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:42:22.702 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:42:22.702 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:22.702 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T03:42:22.702 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:42:22.702 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:42:22.702 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:22.917 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:42:22.939 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:42:22.939 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:22.939 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T03:42:22.939 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:42:22.939 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:42:22.940 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:22.947 INFO:teuthology.orchestra.run.trial127.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T03:42:22.948 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T03:42:22.966 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:42:22.966 INFO:teuthology.orchestra.run.trial127.stdout:Creating group 'qat' with GID 992. 2026-02-13T03:42:22.966 INFO:teuthology.orchestra.run.trial127.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T03:42:22.966 INFO:teuthology.orchestra.run.trial127.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T03:42:22.966 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:22.974 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:42:22.997 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:42:22.998 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T03:42:22.998 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:23.031 INFO:teuthology.orchestra.run.trial127.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T03:42:23.665 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T03:42:23.750 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:42:23.753 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:42:23.772 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:42:23.786 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T03:42:23.802 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T03:42:23.879 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T03:42:23.888 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T03:42:23.912 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T03:42:23.942 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T03:42:23.993 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T03:42:23.999 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T03:42:24.003 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T03:42:24.007 INFO:teuthology.orchestra.run.trial070.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T03:42:24.009 INFO:teuthology.orchestra.run.trial070.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T03:42:24.010 INFO:teuthology.orchestra.run.trial070.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:42:24.028 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:42:24.276 INFO:teuthology.orchestra.run.trial070.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T03:42:24.279 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:42:24.321 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:42:24.321 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T03:42:24.321 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T03:42:24.321 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:24.324 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:42:24.438 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T03:42:24.501 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T03:42:24.503 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:42:24.517 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:42:24.517 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:24.517 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T03:42:24.517 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:24.528 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:42:24.551 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:42:24.552 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:24.552 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T03:42:24.552 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:42:24.552 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:42:24.552 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:24.611 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:42:24.613 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:42:24.622 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T03:42:24.646 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T03:42:24.648 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:42:26.232 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:42:26.239 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:42:26.700 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:42:26.701 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:42:26.763 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:42:26.806 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T03:42:26.807 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:42:26.827 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:42:26.827 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:26.827 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T03:42:26.828 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:42:26.828 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:42:26.828 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:26.839 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:42:26.850 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:42:27.434 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T03:42:27.435 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:42:27.457 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:42:27.457 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:27.458 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T03:42:27.458 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:42:27.458 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:42:27.458 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:27.467 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:42:27.488 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:42:27.488 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:27.488 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T03:42:27.488 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:27.502 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:42:27.523 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:42:27.523 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:27.523 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T03:42:27.523 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:42:27.523 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:42:27.523 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:27.650 INFO:teuthology.orchestra.run.trial127.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:42:27.669 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:42:27.669 INFO:teuthology.orchestra.run.trial127.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:27.670 INFO:teuthology.orchestra.run.trial127.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T03:42:27.670 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:42:27.670 INFO:teuthology.orchestra.run.trial127.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:42:27.670 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:28.955 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:42:28.955 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /sys 2026-02-13T03:42:28.955 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /proc 2026-02-13T03:42:28.955 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /mnt 2026-02-13T03:42:28.955 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /var/tmp 2026-02-13T03:42:28.955 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /home 2026-02-13T03:42:28.955 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /root 2026-02-13T03:42:28.956 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /tmp 2026-02-13T03:42:28.956 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:29.056 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:42:29.079 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:42:29.079 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:29.079 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T03:42:29.079 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:42:29.079 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:42:29.079 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:29.291 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:42:29.312 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:42:29.313 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:29.313 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T03:42:29.313 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:42:29.313 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:42:29.313 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:29.318 INFO:teuthology.orchestra.run.trial070.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T03:42:29.320 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T03:42:29.338 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:42:29.338 INFO:teuthology.orchestra.run.trial070.stdout:Creating group 'qat' with GID 992. 2026-02-13T03:42:29.338 INFO:teuthology.orchestra.run.trial070.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T03:42:29.338 INFO:teuthology.orchestra.run.trial070.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T03:42:29.338 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:29.347 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:42:29.372 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:42:29.372 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T03:42:29.373 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:29.409 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T03:42:30.027 INFO:teuthology.orchestra.run.trial070.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T03:42:30.782 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T03:42:30.845 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T03:42:30.848 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:42:30.862 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:42:30.862 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:30.862 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T03:42:30.862 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:30.872 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:42:30.896 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:42:30.896 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:30.896 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T03:42:30.896 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:42:30.896 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:42:30.896 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:30.955 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:42:30.957 INFO:teuthology.orchestra.run.trial070.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:42:30.966 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T03:42:30.991 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T03:42:30.993 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:42:31.176 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T03:42:31.190 INFO:teuthology.orchestra.run.trial127.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T03:42:31.193 INFO:teuthology.orchestra.run.trial127.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T03:42:31.268 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T03:42:31.287 INFO:teuthology.orchestra.run.trial127.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T03:42:31.292 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T03:42:31.293 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T03:42:31.413 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:42:31.417 INFO:teuthology.orchestra.run.trial127.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:42:31.435 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:42:31.440 INFO:teuthology.orchestra.run.trial127.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T03:42:31.449 INFO:teuthology.orchestra.run.trial127.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T03:42:31.492 INFO:teuthology.orchestra.run.trial127.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:42:31.945 INFO:teuthology.orchestra.run.trial127.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T03:42:31.969 INFO:teuthology.orchestra.run.trial127.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T03:42:31.971 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T03:42:31.974 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:42:31.975 INFO:teuthology.orchestra.run.trial127.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T03:42:31.985 INFO:teuthology.orchestra.run.trial127.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T03:42:32.012 INFO:teuthology.orchestra.run.trial127.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T03:42:32.015 INFO:teuthology.orchestra.run.trial127.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T03:42:32.017 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:42:32.020 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T03:42:32.021 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:42:32.035 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:42:32.035 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:42:32.048 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:42:32.050 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T03:42:32.051 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T03:42:32.053 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T03:42:32.059 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:42:32.059 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:42:32.152 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:42:32.155 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T03:42:32.157 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T03:42:32.159 INFO:teuthology.orchestra.run.trial127.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:42:32.164 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T03:42:32.172 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:42:32.196 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:42:32.560 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:42:32.567 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:42:33.017 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:42:33.018 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:42:33.079 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:42:33.120 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T03:42:33.127 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:42:33.135 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:42:33.135 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T03:42:33.135 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T03:42:33.135 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T03:42:33.135 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T03:42:33.135 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T03:42:33.135 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T03:42:33.135 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T03:42:33.135 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T03:42:33.136 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T03:42:33.137 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T03:42:33.138 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T03:42:33.139 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T03:42:33.140 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T03:42:33.141 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T03:42:33.142 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T03:42:33.143 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T03:42:33.144 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T03:42:33.145 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T03:42:33.146 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T03:42:33.147 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T03:42:33.148 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:42:33.149 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T03:42:33.149 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T03:42:33.149 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T03:42:33.149 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T03:42:33.149 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T03:42:33.149 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T03:42:33.149 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T03:42:33.149 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T03:42:33.149 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T03:42:33.150 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:42:33.150 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:33.150 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T03:42:33.150 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:42:33.150 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:42:33.150 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:33.153 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:42:33.163 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:42:33.206 INFO:teuthology.orchestra.run.trial127.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:42:33.206 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:33.206 INFO:teuthology.orchestra.run.trial127.stdout:Upgraded: 2026-02-13T03:42:33.206 INFO:teuthology.orchestra.run.trial127.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:33.207 INFO:teuthology.orchestra.run.trial127.stdout:Installed: 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.208 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.209 INFO:teuthology.orchestra.run.trial127.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T03:42:33.210 INFO:teuthology.orchestra.run.trial127.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T03:42:33.211 INFO:teuthology.orchestra.run.trial127.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T03:42:33.212 INFO:teuthology.orchestra.run.trial127.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T03:42:33.213 INFO:teuthology.orchestra.run.trial127.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T03:42:33.214 INFO:teuthology.orchestra.run.trial127.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T03:42:33.215 INFO:teuthology.orchestra.run.trial127.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T03:42:33.216 INFO:teuthology.orchestra.run.trial127.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T03:42:33.217 INFO:teuthology.orchestra.run.trial127.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T03:42:33.218 INFO:teuthology.orchestra.run.trial127.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T03:42:33.219 INFO:teuthology.orchestra.run.trial127.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T03:42:33.220 INFO:teuthology.orchestra.run.trial127.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T03:42:33.220 INFO:teuthology.orchestra.run.trial127.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T03:42:33.220 INFO:teuthology.orchestra.run.trial127.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T03:42:33.220 INFO:teuthology.orchestra.run.trial127.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T03:42:33.220 INFO:teuthology.orchestra.run.trial127.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T03:42:33.220 INFO:teuthology.orchestra.run.trial127.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T03:42:33.220 INFO:teuthology.orchestra.run.trial127.stdout: zip-3.0-35.el9.x86_64 2026-02-13T03:42:33.220 INFO:teuthology.orchestra.run.trial127.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T03:42:33.221 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:42:33.221 INFO:teuthology.orchestra.run.trial127.stdout:Complete! 2026-02-13T03:42:33.310 DEBUG:teuthology.parallel:result is None 2026-02-13T03:42:33.730 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T03:42:33.732 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:42:33.754 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:42:33.754 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:33.754 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T03:42:33.754 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:42:33.754 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:42:33.754 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:33.762 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:42:33.783 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:42:33.783 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:33.783 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T03:42:33.783 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:33.796 INFO:teuthology.orchestra.run.trial070.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:42:33.816 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:42:33.816 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:33.816 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T03:42:33.816 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:42:33.816 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:42:33.816 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:33.940 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:42:33.961 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:42:33.961 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:42:33.961 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T03:42:33.961 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:42:33.961 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:42:33.961 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:37.387 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T03:42:37.401 INFO:teuthology.orchestra.run.trial070.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T03:42:37.404 INFO:teuthology.orchestra.run.trial070.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T03:42:37.479 INFO:teuthology.orchestra.run.trial070.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T03:42:37.498 INFO:teuthology.orchestra.run.trial070.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T03:42:37.503 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T03:42:37.504 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T03:42:37.632 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:42:37.636 INFO:teuthology.orchestra.run.trial070.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:42:37.653 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:42:37.658 INFO:teuthology.orchestra.run.trial070.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T03:42:37.667 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T03:42:37.710 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:42:38.164 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T03:42:38.189 INFO:teuthology.orchestra.run.trial070.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T03:42:38.190 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T03:42:38.193 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:42:38.195 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T03:42:38.204 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T03:42:38.231 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T03:42:38.234 INFO:teuthology.orchestra.run.trial070.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T03:42:38.236 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:42:38.239 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T03:42:38.240 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:42:38.253 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:42:38.253 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:42:38.266 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:42:38.267 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T03:42:38.269 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T03:42:38.271 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T03:42:38.277 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:42:38.277 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:42:38.368 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:42:38.370 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T03:42:38.374 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T03:42:38.375 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:42:38.381 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T03:42:38.388 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:42:38.412 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:42:39.345 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:42:39.346 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T03:42:39.346 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T03:42:39.346 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T03:42:39.346 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T03:42:39.346 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T03:42:39.346 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T03:42:39.346 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T03:42:39.346 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T03:42:39.346 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T03:42:39.347 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T03:42:39.348 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T03:42:39.349 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T03:42:39.350 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T03:42:39.351 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T03:42:39.352 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T03:42:39.353 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T03:42:39.354 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T03:42:39.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T03:42:39.356 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T03:42:39.357 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T03:42:39.358 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:42:39.359 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T03:42:39.360 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T03:42:39.360 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T03:42:39.360 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T03:42:39.360 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T03:42:39.360 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T03:42:39.360 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T03:42:39.360 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T03:42:39.360 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T03:42:39.417 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:42:39.417 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:39.417 INFO:teuthology.orchestra.run.trial070.stdout:Upgraded: 2026-02-13T03:42:39.417 INFO:teuthology.orchestra.run.trial070.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:39.417 INFO:teuthology.orchestra.run.trial070.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:39.417 INFO:teuthology.orchestra.run.trial070.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:39.417 INFO:teuthology.orchestra.run.trial070.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T03:42:39.417 INFO:teuthology.orchestra.run.trial070.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T03:42:39.417 INFO:teuthology.orchestra.run.trial070.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.418 INFO:teuthology.orchestra.run.trial070.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.419 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T03:42:39.420 INFO:teuthology.orchestra.run.trial070.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T03:42:39.421 INFO:teuthology.orchestra.run.trial070.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.422 INFO:teuthology.orchestra.run.trial070.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T03:42:39.423 INFO:teuthology.orchestra.run.trial070.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T03:42:39.424 INFO:teuthology.orchestra.run.trial070.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.425 INFO:teuthology.orchestra.run.trial070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T03:42:39.426 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T03:42:39.427 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.428 INFO:teuthology.orchestra.run.trial070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T03:42:39.429 INFO:teuthology.orchestra.run.trial070.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T03:42:39.430 INFO:teuthology.orchestra.run.trial070.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T03:42:39.431 INFO:teuthology.orchestra.run.trial070.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T03:42:39.431 INFO:teuthology.orchestra.run.trial070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T03:42:39.431 INFO:teuthology.orchestra.run.trial070.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T03:42:39.431 INFO:teuthology.orchestra.run.trial070.stdout: zip-3.0-35.el9.x86_64 2026-02-13T03:42:39.431 INFO:teuthology.orchestra.run.trial070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T03:42:39.431 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:39.431 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-13T03:42:39.516 DEBUG:teuthology.parallel:result is None 2026-02-13T03:42:39.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:42:39.687 DEBUG:teuthology.orchestra.run.trial070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T03:42:39.707 INFO:teuthology.orchestra.run.trial070.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T03:42:39.708 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T03:42:39.708 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T03:42:39.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:42:39.865 DEBUG:teuthology.orchestra.run.trial127:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T03:42:39.886 INFO:teuthology.orchestra.run.trial127.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T03:42:39.887 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T03:42:39.887 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T03:42:39.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:42:40.043 DEBUG:teuthology.orchestra.run.trial177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T03:42:40.065 INFO:teuthology.orchestra.run.trial177.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T03:42:40.065 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T03:42:40.066 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T03:42:40.068 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T03:42:40.069 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:42:40.069 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T03:42:40.100 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:42:40.101 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T03:42:40.129 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:42:40.129 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T03:42:40.157 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T03:42:40.157 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:42:40.157 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T03:42:40.182 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T03:42:40.248 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:42:40.248 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T03:42:40.274 DEBUG:teuthology.orchestra.run.trial127:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T03:42:40.339 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:42:40.339 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T03:42:40.365 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T03:42:40.429 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T03:42:40.429 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:42:40.429 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T03:42:40.455 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T03:42:40.519 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:42:40.519 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T03:42:40.543 DEBUG:teuthology.orchestra.run.trial127:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T03:42:40.607 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:42:40.607 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T03:42:40.632 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T03:42:40.695 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T03:42:40.696 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:42:40.696 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T03:42:40.721 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T03:42:40.785 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:42:40.785 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T03:42:40.811 DEBUG:teuthology.orchestra.run.trial127:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T03:42:40.875 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:42:40.875 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T03:42:40.900 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T03:42:40.966 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-13T03:42:41.099 INFO:tasks.cephadm:Config: {'distro-suffix': 'rockylinux-10', 'roleless': False, 'skip_dashboard': True, 'cephfs': {'ec_profile': ['disabled'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds use global snaprealm seq for subvol': False, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'subvols': {'create': 2}} 2026-02-13T03:42:41.099 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T03:42:41.102 INFO:tasks.cephadm:Cluster fsid is 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:42:41.102 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-13T03:42:41.102 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.70', 'mon.b': '10.20.193.127', 'mon.c': '10.20.193.177'} 2026-02-13T03:42:41.102 INFO:tasks.cephadm:First mon is mon.a on trial070 2026-02-13T03:42:41.102 INFO:tasks.cephadm:First mgr is x 2026-02-13T03:42:41.102 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-13T03:42:41.102 DEBUG:teuthology.orchestra.run.trial070:> sudo hostname $(hostname -s) 2026-02-13T03:42:41.127 DEBUG:teuthology.orchestra.run.trial127:> sudo hostname $(hostname -s) 2026-02-13T03:42:41.152 DEBUG:teuthology.orchestra.run.trial177:> sudo hostname $(hostname -s) 2026-02-13T03:42:41.177 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-13T03:42:41.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:42:41.328 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'ref': 'wip-pdonnell-testing-20260210.171210', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-10 22:03:44.386901', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5241-g8f8d3829', 'package_manager_version': '20.3.0-5241.g8f8d3829', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2911/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-13T03:42:41.475 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20260210.171210, sha1 8f8d38294e4db8750b4b1649f62ce37caa63080f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:42:41.476 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T03:42:41.476 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T03:42:41.476 DEBUG:teuthology.orchestra.run.trial070:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T03:42:41.785 INFO:teuthology.orchestra.run.trial070.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 03:42 /home/ubuntu/cephtest/cephadm 2026-02-13T03:42:41.786 DEBUG:teuthology.orchestra.run.trial127:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T03:42:42.113 INFO:teuthology.orchestra.run.trial127.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 03:42 /home/ubuntu/cephtest/cephadm 2026-02-13T03:42:42.113 DEBUG:teuthology.orchestra.run.trial177:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T03:42:42.433 INFO:teuthology.orchestra.run.trial177.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 03:42 /home/ubuntu/cephtest/cephadm 2026-02-13T03:42:42.433 DEBUG:teuthology.orchestra.run.trial070:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T03:42:42.451 DEBUG:teuthology.orchestra.run.trial127:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T03:42:42.470 DEBUG:teuthology.orchestra.run.trial177:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T03:42:42.512 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 on all hosts... 2026-02-13T03:42:42.512 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T03:42:42.515 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T03:42:42.517 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T03:42:42.669 INFO:teuthology.orchestra.run.trial070.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:42:42.671 INFO:teuthology.orchestra.run.trial127.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:42:42.683 INFO:teuthology.orchestra.run.trial177.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:42:53.534 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-13T03:42:53.534 INFO:teuthology.orchestra.run.trial177.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T03:42:53.534 INFO:teuthology.orchestra.run.trial177.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T03:42:53.534 INFO:teuthology.orchestra.run.trial177.stdout: "repo_digests": [ 2026-02-13T03:42:53.534 INFO:teuthology.orchestra.run.trial177.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T03:42:53.534 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-13T03:42:53.534 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-13T03:42:53.538 INFO:teuthology.orchestra.run.trial070.stdout:{ 2026-02-13T03:42:53.538 INFO:teuthology.orchestra.run.trial070.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T03:42:53.538 INFO:teuthology.orchestra.run.trial070.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T03:42:53.538 INFO:teuthology.orchestra.run.trial070.stdout: "repo_digests": [ 2026-02-13T03:42:53.538 INFO:teuthology.orchestra.run.trial070.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T03:42:53.538 INFO:teuthology.orchestra.run.trial070.stdout: ] 2026-02-13T03:42:53.539 INFO:teuthology.orchestra.run.trial070.stdout:} 2026-02-13T03:42:53.564 INFO:teuthology.orchestra.run.trial127.stdout:{ 2026-02-13T03:42:53.564 INFO:teuthology.orchestra.run.trial127.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T03:42:53.564 INFO:teuthology.orchestra.run.trial127.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T03:42:53.564 INFO:teuthology.orchestra.run.trial127.stdout: "repo_digests": [ 2026-02-13T03:42:53.564 INFO:teuthology.orchestra.run.trial127.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T03:42:53.564 INFO:teuthology.orchestra.run.trial127.stdout: ] 2026-02-13T03:42:53.564 INFO:teuthology.orchestra.run.trial127.stdout:} 2026-02-13T03:42:53.580 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /etc/ceph 2026-02-13T03:42:53.653 DEBUG:teuthology.orchestra.run.trial127:> sudo mkdir -p /etc/ceph 2026-02-13T03:42:53.689 DEBUG:teuthology.orchestra.run.trial177:> sudo mkdir -p /etc/ceph 2026-02-13T03:42:53.717 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod 777 /etc/ceph 2026-02-13T03:42:53.742 DEBUG:teuthology.orchestra.run.trial127:> sudo chmod 777 /etc/ceph 2026-02-13T03:42:53.768 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod 777 /etc/ceph 2026-02-13T03:42:53.794 INFO:tasks.cephadm:Writing seed config... 2026-02-13T03:42:53.796 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-13T03:42:53.796 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-13T03:42:53.796 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-13T03:42:53.796 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-13T03:42:53.796 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-13T03:42:53.797 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-13T03:42:53.798 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-13T03:42:53.798 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-13T03:42:53.798 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-13T03:42:53.798 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-13T03:42:53.798 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-13T03:42:53.798 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2026-02-13T03:42:53.799 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:42:53.799 DEBUG:teuthology.orchestra.run.trial070:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-13T03:42:53.817 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0c5cf8b4-088e-11f1-b830-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True 2026-02-13T03:42:53.817 DEBUG:teuthology.orchestra.run.trial070:mon.a> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.a.service 2026-02-13T03:42:53.859 DEBUG:teuthology.orchestra.run.trial070:mgr.x> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.x.service 2026-02-13T03:42:53.902 INFO:tasks.cephadm:Bootstrapping... 2026-02-13T03:42:53.902 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 -v bootstrap --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.70 --skip-dashboard --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:42:54.041 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:42:54.042 INFO:teuthology.orchestra.run.trial070.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', '-v', 'bootstrap', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.70', '--skip-dashboard', '--skip-admin-label'] 2026-02-13T03:42:54.042 INFO:teuthology.orchestra.run.trial070.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-13T03:42:54.042 INFO:teuthology.orchestra.run.trial070.stdout:Verifying podman|docker is present... 2026-02-13T03:42:54.057 INFO:teuthology.orchestra.run.trial070.stdout:/bin/podman: stdout 5.6.0 2026-02-13T03:42:54.058 INFO:teuthology.orchestra.run.trial070.stdout:Verifying lvm2 is present... 2026-02-13T03:42:54.058 INFO:teuthology.orchestra.run.trial070.stdout:Verifying time synchronization is in place... 2026-02-13T03:42:54.064 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T03:42:54.064 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T03:42:54.070 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T03:42:54.070 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout inactive 2026-02-13T03:42:54.076 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout enabled 2026-02-13T03:42:54.082 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout active 2026-02-13T03:42:54.082 INFO:teuthology.orchestra.run.trial070.stdout:Unit chronyd.service is enabled and running 2026-02-13T03:42:54.082 INFO:teuthology.orchestra.run.trial070.stdout:Repeating the final host check... 2026-02-13T03:42:54.097 INFO:teuthology.orchestra.run.trial070.stdout:/bin/podman: stdout 5.6.0 2026-02-13T03:42:54.098 INFO:teuthology.orchestra.run.trial070.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-13T03:42:54.098 INFO:teuthology.orchestra.run.trial070.stdout:systemctl is present 2026-02-13T03:42:54.098 INFO:teuthology.orchestra.run.trial070.stdout:lvcreate is present 2026-02-13T03:42:54.103 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T03:42:54.103 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T03:42:54.108 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T03:42:54.108 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout inactive 2026-02-13T03:42:54.114 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout enabled 2026-02-13T03:42:54.120 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout active 2026-02-13T03:42:54.121 INFO:teuthology.orchestra.run.trial070.stdout:Unit chronyd.service is enabled and running 2026-02-13T03:42:54.121 INFO:teuthology.orchestra.run.trial070.stdout:Host looks OK 2026-02-13T03:42:54.121 INFO:teuthology.orchestra.run.trial070.stdout:Cluster fsid: 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:42:54.121 INFO:teuthology.orchestra.run.trial070.stdout:Acquiring lock 139662647512944 on /run/cephadm/0c5cf8b4-088e-11f1-b830-d404e6e7d460.lock 2026-02-13T03:42:54.121 INFO:teuthology.orchestra.run.trial070.stdout:Lock 139662647512944 acquired on /run/cephadm/0c5cf8b4-088e-11f1-b830-d404e6e7d460.lock 2026-02-13T03:42:54.121 INFO:teuthology.orchestra.run.trial070.stdout:Verifying IP 10.20.193.70 port 3300 ... 2026-02-13T03:42:54.122 INFO:teuthology.orchestra.run.trial070.stdout:Verifying IP 10.20.193.70 port 6789 ... 2026-02-13T03:42:54.122 INFO:teuthology.orchestra.run.trial070.stdout:Base mon IP(s) is [10.20.193.70:3300, 10.20.193.70:6789], mon addrv is [v2:10.20.193.70:3300,v1:10.20.193.70:6789] 2026-02-13T03:42:54.124 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.70 metric 102 2026-02-13T03:42:54.124 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.70 metric 102 2026-02-13T03:42:54.125 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-13T03:42:54.127 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-13T03:42:54.127 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-13T03:42:54.127 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-13T03:42:54.130 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-13T03:42:54.130 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-13T03:42:54.130 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T03:42:54.130 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-13T03:42:54.130 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout inet6 fe80::7ac5:a14f:f124:59f2/64 scope link noprefixroute 2026-02-13T03:42:54.130 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T03:42:54.131 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-13T03:42:54.131 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:64c2/64 scope link 2026-02-13T03:42:54.131 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T03:42:54.131 INFO:teuthology.orchestra.run.trial070.stdout:Mon IP `10.20.193.70` is in CIDR network `10.20.192.0/20` 2026-02-13T03:42:54.131 INFO:teuthology.orchestra.run.trial070.stdout:Mon IP `10.20.193.70` is in CIDR network `10.20.192.0/20` 2026-02-13T03:42:54.131 INFO:teuthology.orchestra.run.trial070.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-13T03:42:54.131 INFO:teuthology.orchestra.run.trial070.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-13T03:42:54.131 INFO:teuthology.orchestra.run.trial070.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:42:54.366 INFO:teuthology.orchestra.run.trial070.stdout:/bin/podman: stdout b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T03:42:54.367 INFO:teuthology.orchestra.run.trial070.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:42:54.367 INFO:teuthology.orchestra.run.trial070.stdout:/bin/podman: stderr Getting image source signatures 2026-02-13T03:42:54.367 INFO:teuthology.orchestra.run.trial070.stdout:/bin/podman: stderr Copying blob sha256:9b7325f35ad40fc8a795fce82955bc486ff370c187eaa160f4df65d0fb22f2a2 2026-02-13T03:42:54.367 INFO:teuthology.orchestra.run.trial070.stdout:/bin/podman: stderr Copying blob sha256:0c53e9fad0324c188a40a9b1e0ca4eb777da2812507ec104055fa6ec400d9a27 2026-02-13T03:42:54.367 INFO:teuthology.orchestra.run.trial070.stdout:/bin/podman: stderr Copying config sha256:b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T03:42:54.367 INFO:teuthology.orchestra.run.trial070.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-13T03:42:54.492 INFO:teuthology.orchestra.run.trial070.stdout:ceph: stdout ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T03:42:54.493 INFO:teuthology.orchestra.run.trial070.stdout:Ceph version: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T03:42:54.493 INFO:teuthology.orchestra.run.trial070.stdout:Extracting ceph user uid/gid from container image... 2026-02-13T03:42:54.606 INFO:teuthology.orchestra.run.trial070.stdout:stat: stdout 167 167 2026-02-13T03:42:54.606 INFO:teuthology.orchestra.run.trial070.stdout:Creating initial keys... 2026-02-13T03:42:54.733 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph-authtool: stdout AQC+nY5pdRtRKhAAQFhPAtYlXdn4oDBkT6OB/A== 2026-02-13T03:42:54.803 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph-authtool: stdout AQC+nY5pVL79LhAAFAJ8kUJOtTX/a3c22d3miw== 2026-02-13T03:42:54.924 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph-authtool: stdout AQC+nY5pXTVsNRAAqNM+bnoRNCjTV7rseiiRLQ== 2026-02-13T03:42:54.925 INFO:teuthology.orchestra.run.trial070.stdout:Creating initial monmap... 2026-02-13T03:42:55.049 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T03:42:55.049 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-13T03:42:55.049 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:42:55.049 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T03:42:55.049 INFO:teuthology.orchestra.run.trial070.stdout:monmaptool for a [v2:10.20.193.70:3300,v1:10.20.193.70:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T03:42:55.049 INFO:teuthology.orchestra.run.trial070.stdout:setting min_mon_release = tentacle 2026-02-13T03:42:55.049 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/monmaptool: set fsid to 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:42:55.050 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T03:42:55.050 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:42:55.050 INFO:teuthology.orchestra.run.trial070.stdout:Creating mon... 2026-02-13T03:42:55.184 INFO:teuthology.orchestra.run.trial070.stdout:create mon.a on 2026-02-13T03:42:55.354 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-13T03:42:55.456 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-13T03:42:55.564 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460.target → /etc/systemd/system/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460.target. 2026-02-13T03:42:55.565 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460.target → /etc/systemd/system/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460.target. 2026-02-13T03:42:55.688 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.a 2026-02-13T03:42:55.688 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.a.service: Unit ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.a.service not loaded. 2026-02-13T03:42:55.817 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460.target.wants/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@.service. 2026-02-13T03:42:55.968 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T03:42:55.968 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout disabled 2026-02-13T03:42:55.974 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T03:42:55.974 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout inactive 2026-02-13T03:42:55.974 INFO:teuthology.orchestra.run.trial070.stdout:firewalld.service is not enabled 2026-02-13T03:42:55.974 INFO:teuthology.orchestra.run.trial070.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T03:42:55.974 INFO:teuthology.orchestra.run.trial070.stdout:Waiting for mon to start... 2026-02-13T03:42:55.974 INFO:teuthology.orchestra.run.trial070.stdout:Waiting for mon... 2026-02-13T03:42:56.143 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout cluster: 2026-02-13T03:42:56.143 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout id: 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:42:56.143 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-13T03:42:56.143 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout services: 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.144725s) [leader: a] 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout data: 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout pgs: 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:42:56.144 INFO:teuthology.orchestra.run.trial070.stdout:mon is available 2026-02-13T03:42:56.145 INFO:teuthology.orchestra.run.trial070.stdout:Assimilating anything we can from ceph.conf... 2026-02-13T03:42:56.307 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:42:56.307 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T03:42:56.307 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout fsid = 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:42:56.307 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T03:42:56.307 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.70:3300,v1:10.20.193.70:6789] 2026-02-13T03:42:56.307 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T03:42:56.307 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T03:42:56.308 INFO:teuthology.orchestra.run.trial070.stdout:Generating new minimal ceph.conf... 2026-02-13T03:42:56.481 INFO:teuthology.orchestra.run.trial070.stdout:Restarting the monitor... 2026-02-13T03:42:56.678 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a[24324]: 2026-02-13T03:42:56.555+0000 7ff4ee6a36c0 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-13T03:42:56.679 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 podman[24605]: 2026-02-13 03:42:56.677719904 +0000 UTC m=+0.134370253 container died 1e07f2cd3d59b83da21241b61b5f4056cd1189979938fa56b099b5ace90e10da (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.version=10, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T03:42:56.872 INFO:teuthology.orchestra.run.trial070.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-13T03:42:56.939 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 podman[24605]: 2026-02-13 03:42:56.68820471 +0000 UTC m=+0.144855069 container remove 1e07f2cd3d59b83da21241b61b5f4056cd1189979938fa56b099b5ace90e10da (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T03:42:56.939 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 bash[24605]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a 2026-02-13T03:42:56.939 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 systemd[1]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-13T03:42:56.939 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 systemd[1]: Stopped Ceph mon.a for 0c5cf8b4-088e-11f1-b830-d404e6e7d460. 2026-02-13T03:42:56.939 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 systemd[1]: Starting Ceph mon.a for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:42:56.939 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 podman[24729]: 2026-02-13 03:42:56.831890298 +0000 UTC m=+0.015686414 container create 8c0222b189f3a09516b07382ebc623bba7cc68ed432f300ae57605d6f4135a5d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, ceph=True, summary=Rocky Linux Base image, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux) 2026-02-13T03:42:56.939 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 podman[24729]: 2026-02-13 03:42:56.863527979 +0000 UTC m=+0.047324035 container init 8c0222b189f3a09516b07382ebc623bba7cc68ed432f300ae57605d6f4135a5d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 podman[24729]: 2026-02-13 03:42:56.865839188 +0000 UTC m=+0.049635244 container start 8c0222b189f3a09516b07382ebc623bba7cc68ed432f300ae57605d6f4135a5d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, summary=Rocky Linux Base image) 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 bash[24729]: 8c0222b189f3a09516b07382ebc623bba7cc68ed432f300ae57605d6f4135a5d 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 podman[24729]: 2026-02-13 03:42:56.825514622 +0000 UTC m=+0.009310678 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 systemd[1]: Started Ceph mon.a for 0c5cf8b4-088e-11f1-b830-d404e6e7d460. 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: pidfile_write: ignore empty --pid-file 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: load: jerasure load: lrc 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: RocksDB version: 7.9.2 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Git sha 0 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T03:42:56.940 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: DB SUMMARY 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: DB Session ID: TU6W4WT0KH6833HNSXOV 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: CURRENT file: CURRENT 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 82213 ; 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.error_if_exists: 0 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.create_if_missing: 0 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.paranoid_checks: 1 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T03:42:56.941 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.env: 0x5626e7d9e2c0 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.info_log: 0x5626e98ecd60 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.statistics: (nil) 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.use_fsync: 0 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_log_file_size: 0 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.allow_fallocate: 1 2026-02-13T03:42:56.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.use_direct_reads: 0 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.db_log_dir: 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.wal_dir: 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T03:42:56.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.write_buffer_manager: 0x5626e98e3b80 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.unordered_write: 0 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T03:42:56.944 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T03:42:56.945 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T03:42:56.945 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.row_cache: None 2026-02-13T03:42:56.946 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.wal_filter: None 2026-02-13T03:42:56.946 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T03:42:56.946 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T03:42:56.946 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.two_write_queues: 0 2026-02-13T03:42:56.946 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T03:42:56.946 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.wal_compression: 0 2026-02-13T03:42:56.946 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.atomic_flush: 0 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.log_readahead_size: 0 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T03:42:56.947 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_background_jobs: 2 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_background_compactions: -1 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_subcompactions: 1 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_open_files: -1 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T03:42:56.948 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_background_flushes: -1 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Compression algorithms supported: 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: kZSTD supported: 0 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: kXpressCompression supported: 0 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: kBZip2Compression supported: 0 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: kLZ4Compression supported: 1 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: kZlibCompression supported: 1 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: kSnappyCompression supported: 1 2026-02-13T03:42:56.949 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.merge_operator: 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_filter: None 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5626e9a6c360) 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout: cache_index_and_filter_blocks: 1 2026-02-13T03:42:56.950 INFO:journalctl@ceph.mon.a.trial070.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: pin_top_level_index_and_filter: 1 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: index_type: 0 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: data_block_index_type: 0 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: index_shortening: 1 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: checksum: 4 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: no_block_cache: 0 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: block_cache: 0x5626e98e5690 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: block_cache_name: BinnedLRUCache 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: block_cache_options: 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: capacity : 536870912 2026-02-13T03:42:56.951 INFO:journalctl@ceph.mon.a.trial070.stdout: num_shard_bits : 4 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: strict_capacity_limit : 0 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: high_pri_pool_ratio: 0.000 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: block_cache_compressed: (nil) 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: persistent_cache: (nil) 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: block_size: 4096 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: block_size_deviation: 10 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: block_restart_interval: 16 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: index_block_restart_interval: 1 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: metadata_block_size: 4096 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: partition_filters: 0 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: use_delta_encoding: 1 2026-02-13T03:42:56.952 INFO:journalctl@ceph.mon.a.trial070.stdout: filter_policy: bloomfilter 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: whole_key_filtering: 1 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: verify_compression: 0 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: read_amp_bytes_per_bit: 0 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: format_version: 5 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: enable_index_compression: 1 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: block_align: 0 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: max_auto_readahead_size: 262144 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: prepopulate_block_cache: 0 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: initial_auto_readahead_size: 8192 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T03:42:56.953 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression: NoCompression 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.num_levels: 7 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T03:42:56.954 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T03:42:56.955 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T03:42:56.956 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T03:42:56.957 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.inplace_update_support: 0 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.bloom_locality: 0 2026-02-13T03:42:56.958 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.max_successive_merges: 0 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.ttl: 2592000 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.enable_blob_files: false 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.min_blob_size: 0 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T03:42:56.959 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 159ef5aa-d0a0-40aa-bd96-b1467e733a6f 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770954176881207, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-13T03:42:56.960 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770954176881866, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 78864, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 251, "table_properties": {"data_size": 77041, "index_size": 208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11114, "raw_average_key_size": 50, "raw_value_size": 70773, "raw_average_value_size": 318, "num_data_blocks": 9, "num_entries": 222, "num_filter_entries": 222, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770954176, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "159ef5aa-d0a0-40aa-bd96-b1467e733a6f", "db_session_id": "TU6W4WT0KH6833HNSXOV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770954176881916, "job": 1, "event": "recovery_finished"} 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5626e9908e00 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: DB pointer 0x5626ea70e000 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout: ** DB Stats ** 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T03:42:56.961 INFO:journalctl@ceph.mon.a.trial070.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: ** Compaction Stats [default] ** 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: L0 2/0 78.88 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: Sum 2/0 78.88 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 161.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: ** Compaction Stats [default] ** 2026-02-13T03:42:56.962 INFO:journalctl@ceph.mon.a.trial070.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 161.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T03:42:56.963 INFO:journalctl@ceph.mon.a.trial070.stdout: Cumulative compaction: 0.00 GB write, 30.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout: Interval compaction: 0.00 GB write, 30.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout: Block cache BinnedLRUCache@0x5626e98e5690#2 capacity: 512.00 MB usage: 1.16 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.39 KB,7.45058e-05%) Misc(1,0.00 KB,0%) 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout: 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: starting mon.a rank 0 at public addrs [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] at bind addrs [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mon.a@-1(???) e1 preinit fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mon.a@-1(???).mds e1 new map 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mon.a@-1(???).mds e1 print_map 2026-02-13T03:42:56.964 INFO:journalctl@ceph.mon.a.trial070.stdout: e1 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout: btime 2026-02-13T03:42:55:978956+0000 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout: legacy client fscid: -1 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout: 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout: No filesystems configured 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T03:42:56.965 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: monmap epoch 1 2026-02-13T03:42:56.966 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:42:56.966 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: last_changed 2026-02-13T03:42:55.021029+0000 2026-02-13T03:42:56.966 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: created 2026-02-13T03:42:55.021029+0000 2026-02-13T03:42:56.966 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: min_mon_release 20 (tentacle) 2026-02-13T03:42:56.966 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: election_strategy: 1 2026-02-13T03:42:56.966 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: 0: [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] mon.a 2026-02-13T03:42:56.966 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: fsmap 2026-02-13T03:42:56.966 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T03:42:56.966 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:56 trial070 ceph-mon[24757]: mgrmap e1: no daemons active 2026-02-13T03:42:57.038 INFO:teuthology.orchestra.run.trial070.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-13T03:42:57.039 INFO:teuthology.orchestra.run.trial070.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:42:57.039 INFO:teuthology.orchestra.run.trial070.stdout:Creating mgr... 2026-02-13T03:42:57.039 INFO:teuthology.orchestra.run.trial070.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-13T03:42:57.040 INFO:teuthology.orchestra.run.trial070.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-13T03:42:57.161 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.x 2026-02-13T03:42:57.162 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.x.service: Unit ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.x.service not loaded. 2026-02-13T03:42:57.267 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460.target.wants/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@.service. 2026-02-13T03:42:57.413 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T03:42:57.413 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout disabled 2026-02-13T03:42:57.419 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T03:42:57.419 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout inactive 2026-02-13T03:42:57.419 INFO:teuthology.orchestra.run.trial070.stdout:firewalld.service is not enabled 2026-02-13T03:42:57.419 INFO:teuthology.orchestra.run.trial070.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T03:42:57.427 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T03:42:57.427 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout disabled 2026-02-13T03:42:57.433 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T03:42:57.433 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout inactive 2026-02-13T03:42:57.433 INFO:teuthology.orchestra.run.trial070.stdout:firewalld.service is not enabled 2026-02-13T03:42:57.433 INFO:teuthology.orchestra.run.trial070.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-13T03:42:57.434 INFO:teuthology.orchestra.run.trial070.stdout:Waiting for mgr to start... 2026-02-13T03:42:57.434 INFO:teuthology.orchestra.run.trial070.stdout:Waiting for mgr... 2026-02-13T03:42:57.619 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:42:57.619 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:42:57.619 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "fsid": "0c5cf8b4-088e-11f1-b830-d404e6e7d460", 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 0 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T03:42:57.620 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T03:42:57.621 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T03:42:57.622 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T03:42:55:978956+0000", 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:42:57.623 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:42:57.624 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:57.624 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T03:42:57.624 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:42:57.624 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T03:42:55.979385+0000", 2026-02-13T03:42:57.624 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:42:57.624 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:57.624 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T03:42:57.624 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:42:57.624 INFO:teuthology.orchestra.run.trial070.stdout:mgr not available, waiting (1/15)... 2026-02-13T03:42:57.805 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.802+0000 7f265784efc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:42:58.171 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:58 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1475518328' entity='client.admin' 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:58 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2254975465' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.841+0000 7f265784efc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.843+0000 7f265784efc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.847+0000 7f265784efc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.849+0000 7f265784efc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.849+0000 7f265784efc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.852+0000 7f265784efc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.853+0000 7f265784efc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.856+0000 7f265784efc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:42:58.172 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:57 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:57.858+0000 7f265784efc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:42:58.173 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.023+0000 7f265784efc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:42:58.173 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.023+0000 7f265784efc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:42:58.173 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.026+0000 7f265784efc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:42:58.173 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.028+0000 7f265784efc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:42:58.173 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.029+0000 7f265784efc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:42:58.173 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.030+0000 7f265784efc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:42:58.173 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.030+0000 7f265784efc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:42:58.173 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.169+0000 7f265784efc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:42:58.548 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.198+0000 7f265784efc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:42:58.548 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.202+0000 7f265784efc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:42:58.548 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.202+0000 7f265784efc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:42:58.548 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:42:58 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:42:58.203+0000 7f265784efc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: Activating manager daemon x 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: mgrmap e2: x(active, starting, since 0.00245332s) 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: Manager daemon x is now available 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' 2026-02-13T03:42:59.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:42:59.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' 2026-02-13T03:42:59.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:42:59 trial070 ceph-mon[24757]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' 2026-02-13T03:42:59.887 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:42:59.887 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:42:59.887 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "fsid": "0c5cf8b4-088e-11f1-b830-d404e6e7d460", 2026-02-13T03:42:59.887 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T03:42:59.887 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T03:42:59.887 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T03:42:59.887 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 0 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:42:59.888 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T03:42:59.889 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T03:42:55:978956+0000", 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T03:42:59.890 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:42:59.891 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T03:42:55.979385+0000", 2026-02-13T03:42:59.892 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:42:59.892 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:42:59.892 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T03:42:59.892 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:42:59.892 INFO:teuthology.orchestra.run.trial070.stdout:mgr is available 2026-02-13T03:43:00.106 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:43:00.106 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T03:43:00.106 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout fsid = 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:00.106 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T03:43:00.106 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.70:3300,v1:10.20.193.70:6789] 2026-02-13T03:43:00.106 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T03:43:00.106 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T03:43:00.106 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T03:43:00.106 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T03:43:00.107 INFO:teuthology.orchestra.run.trial070.stdout:Enabling cephadm module... 2026-02-13T03:43:00.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:00 trial070 ceph-mon[24757]: mgrmap e3: x(active, since 1.00459s) 2026-02-13T03:43:00.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:00 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2669317323' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T03:43:00.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:00 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3077146810' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T03:43:01.473 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:01 trial070 ceph-mon[24757]: mgrmap e4: x(active, since 2s) 2026-02-13T03:43:01.473 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:01 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/408395870' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T03:43:01.473 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: ignoring --setuser ceph since I am not root 2026-02-13T03:43:01.474 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: ignoring --setgroup ceph since I am not root 2026-02-13T03:43:01.474 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.252+0000 7f9fcf476fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T03:43:01.474 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.295+0000 7f9fcf476fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:43:01.499 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:43:01.499 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-13T03:43:01.499 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T03:43:01.499 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-13T03:43:01.499 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T03:43:01.499 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:43:01.499 INFO:teuthology.orchestra.run.trial070.stdout:Waiting for the mgr to restart... 2026-02-13T03:43:01.499 INFO:teuthology.orchestra.run.trial070.stdout:Waiting for mgr epoch 5... 2026-02-13T03:43:01.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.548+0000 7f9fcf476fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:43:01.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.558+0000 7f9fcf476fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:43:01.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.564+0000 7f9fcf476fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.570+0000 7f9fcf476fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.576+0000 7f9fcf476fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.588+0000 7f9fcf476fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.613+0000 7f9fcf476fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.617+0000 7f9fcf476fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.618+0000 7f9fcf476fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.625+0000 7f9fcf476fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.660+0000 7f9fcf476fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.662+0000 7f9fcf476fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.666+0000 7f9fcf476fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.668+0000 7f9fcf476fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:43:01.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.669+0000 7f9fcf476fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:43:01.800 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.671+0000 7f9fcf476fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:43:01.800 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.672+0000 7f9fcf476fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:43:01.800 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.675+0000 7f9fcf476fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:43:01.800 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.677+0000 7f9fcf476fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:43:02.218 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.834+0000 7f9fcf476fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:43:02.218 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.834+0000 7f9fcf476fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:43:02.218 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.837+0000 7f9fcf476fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:43:02.218 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.839+0000 7f9fcf476fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:43:02.218 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.840+0000 7f9fcf476fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:43:02.218 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.841+0000 7f9fcf476fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:43:02.218 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.841+0000 7f9fcf476fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:43:02.219 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:01 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:01.980+0000 7f9fcf476fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:43:02.219 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:02 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:02.009+0000 7f9fcf476fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:43:02.219 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:02 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:02.013+0000 7f9fcf476fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:43:02.219 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:02 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:02.013+0000 7f9fcf476fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:43:02.219 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:02 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:43:02.014+0000 7f9fcf476fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:43:02.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/408395870' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T03:43:02.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: mgrmap e5: x(active, since 3s) 2026-02-13T03:43:02.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2268964805' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T03:43:02.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: Active manager daemon x restarted 2026-02-13T03:43:02.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: Activating manager daemon x 2026-02-13T03:43:02.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T03:43:02.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: mgrmap e6: x(active, starting, since 0.00308704s) 2026-02-13T03:43:02.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:43:02.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:43:02.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:43:02.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:43:02.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:43:02.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:02 trial070 ceph-mon[24757]: Manager daemon x is now available 2026-02-13T03:43:03.052 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:43:03.052 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-13T03:43:03.052 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T03:43:03.052 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:43:03.052 INFO:teuthology.orchestra.run.trial070.stdout:mgr epoch 5 is available 2026-02-13T03:43:03.052 INFO:teuthology.orchestra.run.trial070.stdout:Verifying orchestrator module is enabled... 2026-02-13T03:43:04.023 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:04.024 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:43:04.025 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:43:04.025 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: mgrmap e7: x(active, since 1.00403s) 2026-02-13T03:43:04.025 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1789130002' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T03:43:04.025 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:04.050 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-13T03:43:04.051 INFO:teuthology.orchestra.run.trial070.stdout:Setting orchestrator backend to cephadm... 2026-02-13T03:43:04.517 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-13T03:43:04.518 INFO:teuthology.orchestra.run.trial070.stdout:Generating ssh key... 2026-02-13T03:43:04.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: Generating public/private ed25519 key pair. 2026-02-13T03:43:04.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: Your identification has been saved in /tmp/tmpsr_7ft85/key 2026-02-13T03:43:04.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: Your public key has been saved in /tmp/tmpsr_7ft85/key.pub 2026-02-13T03:43:04.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: The key fingerprint is: 2026-02-13T03:43:04.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: SHA256:HmhEGsWE6UUxDWXGL+jIVxXdXshf4Hnf4DluPlHkqUQ ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:04.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: The key's randomart image is: 2026-02-13T03:43:04.798 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: +--[ED25519 256]--+ 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: | .BO*+ .o o.o | 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: | o+o+o . .E+.+| 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: | ..... o ..+=+| 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: | ....o . o.=*| 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: | . oo.S. . =.o| 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: | o.o. . o.. | 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: | . . o. | 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: | o. | 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: | .. | 2026-02-13T03:43:04.799 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:43:04 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: +----[SHA256]-----+ 2026-02-13T03:43:05.056 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOopfXw4VA1LB7uOVnF5QsxTiyFaDOnfUoiN54hHmvO2 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:05.057 INFO:teuthology.orchestra.run.trial070.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-13T03:43:05.057 INFO:teuthology.orchestra.run.trial070.stdout:Adding key to root@localhost authorized_keys... 2026-02-13T03:43:05.057 INFO:teuthology.orchestra.run.trial070.stdout:Adding host trial070... 2026-02-13T03:43:05.059 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: Optimize plan auto_2026-02-13_03:43:02, mode upmap, max misplaced 0.050000 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: No pools available 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: Found migration_current of "None". Setting to last migration. 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1789130002' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: mgrmap e8: x(active, since 2s) 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:05.060 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:06.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:06 trial070 ceph-mon[24757]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:06.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:06 trial070 ceph-mon[24757]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:06.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:06 trial070 ceph-mon[24757]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:06.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:06 trial070 ceph-mon[24757]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:07.094 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout Added host 'trial070' with addr '10.20.193.70' 2026-02-13T03:43:07.094 INFO:teuthology.orchestra.run.trial070.stdout:Deploying unmanaged mon service... 2026-02-13T03:43:07.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:07 trial070 ceph-mon[24757]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial070", "addr": "10.20.193.70", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:07.349 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-13T03:43:07.349 INFO:teuthology.orchestra.run.trial070.stdout:Deploying unmanaged mgr service... 2026-02-13T03:43:07.586 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-13T03:43:07.813 INFO:teuthology.orchestra.run.trial070.stdout:Saving cluster configuration to /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/config directory 2026-02-13T03:43:08.090 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:08.090 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:08.090 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:08.090 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:08.090 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:08.091 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:08 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2798859671' entity='client.admin' 2026-02-13T03:43:08.091 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:08.095 INFO:teuthology.orchestra.run.trial070.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout:Or, if you are only running a single cluster on this host: 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout: ceph telemetry on 2026-02-13T03:43:08.096 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:08.097 INFO:teuthology.orchestra.run.trial070.stdout:For more information see: 2026-02-13T03:43:08.097 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:08.097 INFO:teuthology.orchestra.run.trial070.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-13T03:43:08.097 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:08.097 INFO:teuthology.orchestra.run.trial070.stdout:Bootstrap complete. 2026-02-13T03:43:08.103 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout static 2026-02-13T03:43:08.109 INFO:teuthology.orchestra.run.trial070.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-13T03:43:08.109 INFO:teuthology.orchestra.run.trial070.stdout:systemctl: stdout inactive 2026-02-13T03:43:08.109 INFO:teuthology.orchestra.run.trial070.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-13T03:43:08.260 INFO:tasks.cephadm:Fetching config... 2026-02-13T03:43:08.260 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:43:08.260 DEBUG:teuthology.orchestra.run.trial070:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-13T03:43:08.277 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-13T03:43:08.277 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:43:08.277 DEBUG:teuthology.orchestra.run.trial070:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-13T03:43:08.334 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-13T03:43:08.334 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:43:08.334 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-13T03:43:08.400 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-13T03:43:08.400 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:43:08.400 DEBUG:teuthology.orchestra.run.trial070:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-13T03:43:08.457 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-13T03:43:08.458 DEBUG:teuthology.orchestra.run.trial070:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOopfXw4VA1LB7uOVnF5QsxTiyFaDOnfUoiN54hHmvO2 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T03:43:08.531 INFO:teuthology.orchestra.run.trial070.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOopfXw4VA1LB7uOVnF5QsxTiyFaDOnfUoiN54hHmvO2 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:08.542 DEBUG:teuthology.orchestra.run.trial127:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOopfXw4VA1LB7uOVnF5QsxTiyFaDOnfUoiN54hHmvO2 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T03:43:08.576 INFO:teuthology.orchestra.run.trial127.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOopfXw4VA1LB7uOVnF5QsxTiyFaDOnfUoiN54hHmvO2 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:08.586 DEBUG:teuthology.orchestra.run.trial177:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOopfXw4VA1LB7uOVnF5QsxTiyFaDOnfUoiN54hHmvO2 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T03:43:08.621 INFO:teuthology.orchestra.run.trial177.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOopfXw4VA1LB7uOVnF5QsxTiyFaDOnfUoiN54hHmvO2 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:08.631 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-13T03:43:08.745 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:09.006 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-13T03:43:09.007 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-13T03:43:09.126 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:09.240 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:09 trial070 ceph-mon[24757]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:09.240 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:09 trial070 ceph-mon[24757]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:09.241 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:09 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2587230903' entity='client.admin' 2026-02-13T03:43:09.241 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:09 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:09.241 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:09 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2615678397' entity='client.admin' 2026-02-13T03:43:09.398 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial127 2026-02-13T03:43:09.398 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:43:09.398 DEBUG:teuthology.orchestra.run.trial127:> dd of=/etc/ceph/ceph.conf 2026-02-13T03:43:09.416 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:43:09.416 DEBUG:teuthology.orchestra.run.trial127:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:43:09.472 INFO:tasks.cephadm:Adding host trial127 to orchestrator... 2026-02-13T03:43:09.472 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch host add trial127 2026-02-13T03:43:09.587 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:10.293 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:10.293 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:11.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:11 trial070 ceph-mon[24757]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:11.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:11 trial070 ceph-mon[24757]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial127", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:11.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:11.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:11.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:11.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:11.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial070", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:11.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:11.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:11.638 INFO:teuthology.orchestra.run.trial070.stdout:Added host 'trial127' with addr '10.20.193.127' 2026-02-13T03:43:11.687 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T03:43:11.808 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:12.027 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:12.027 INFO:teuthology.orchestra.run.trial070.stdout:[{"addr": "10.20.193.70", "hostname": "trial070", "labels": [], "status": ""}, {"addr": "10.20.193.127", "hostname": "trial127", "labels": [], "status": ""}] 2026-02-13T03:43:12.068 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial177 2026-02-13T03:43:12.068 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:43:12.069 DEBUG:teuthology.orchestra.run.trial177:> dd of=/etc/ceph/ceph.conf 2026-02-13T03:43:12.086 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:43:12.086 DEBUG:teuthology.orchestra.run.trial177:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:43:12.142 INFO:tasks.cephadm:Adding host trial177 to orchestrator... 2026-02-13T03:43:12.143 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch host add trial177 2026-02-13T03:43:12.264 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:12.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:12.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:12.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:43:12.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:13 trial070 ceph-mon[24757]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial177", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial127", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:14.338 INFO:teuthology.orchestra.run.trial070.stdout:Added host 'trial177' with addr '10.20.193.177' 2026-02-13T03:43:14.380 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T03:43:14.495 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:14.709 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:14.709 INFO:teuthology.orchestra.run.trial070.stdout:[{"addr": "10.20.193.70", "hostname": "trial070", "labels": [], "status": ""}, {"addr": "10.20.193.127", "hostname": "trial127", "labels": [], "status": ""}, {"addr": "10.20.193.177", "hostname": "trial177", "labels": [], "status": ""}] 2026-02-13T03:43:14.749 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-13T03:43:14.749 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd crush tunables default 2026-02-13T03:43:14.864 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:15.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:15.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:15.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:15 trial070 ceph-mon[24757]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:43:15.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:15.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:15 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2678480727' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T03:43:15.922 INFO:teuthology.orchestra.run.trial070.stderr:adjusted tunables profile to default 2026-02-13T03:43:15.983 INFO:tasks.cephadm:Adding mon.a on trial070 2026-02-13T03:43:15.983 INFO:tasks.cephadm:Adding mon.b on trial127 2026-02-13T03:43:15.984 INFO:tasks.cephadm:Adding mon.c on trial177 2026-02-13T03:43:15.984 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch apply mon '3;trial070:10.20.193.70=a;trial127:10.20.193.127=b;trial177:10.20.193.177=c' 2026-02-13T03:43:16.126 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:43:16.126 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:43:16.341 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled mon update... 2026-02-13T03:43:16.383 DEBUG:teuthology.orchestra.run.trial127:mon.b> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.b.service 2026-02-13T03:43:16.386 DEBUG:teuthology.orchestra.run.trial177:mon.c> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.c.service 2026-02-13T03:43:16.389 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:43:16.389 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:43:16.545 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:43:16.545 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:43:16.800 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:43:16.800 INFO:teuthology.orchestra.run.trial177.stdout:{"epoch":1,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","modified":"2026-02-13T03:42:55.021029Z","created":"2026-02-13T03:42:55.021029Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:3300","nonce":0},{"type":"v1","addr":"10.20.193.70:6789","nonce":0}]},"addr":"10.20.193.70:6789/0","public_addr":"10.20.193.70:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:42:55:021037+0000","crush_location":[]}],"quorum":[0]} 2026-02-13T03:43:16.801 INFO:teuthology.orchestra.run.trial177.stderr:dumped monmap epoch 1 2026-02-13T03:43:17.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:17.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2678480727' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T03:43:17.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:43:17.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:17.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:17.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:17.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:17.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:17.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:17.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:17.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:17.841 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:43:17.841 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:43:18.045 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:43:18.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:17 trial070 ceph-mon[24757]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial070:10.20.193.70=a;trial127:10.20.193.127=b;trial177:10.20.193.177=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:17 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/520648588' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:43:18.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:18.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:18.384 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:43:18.384 INFO:teuthology.orchestra.run.trial177.stdout:{"epoch":1,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","modified":"2026-02-13T03:42:55.021029Z","created":"2026-02-13T03:42:55.021029Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:3300","nonce":0},{"type":"v1","addr":"10.20.193.70:6789","nonce":0}]},"addr":"10.20.193.70:6789/0","public_addr":"10.20.193.70:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:42:55:021037+0000","crush_location":[]}],"quorum":[0]} 2026-02-13T03:43:18.385 INFO:teuthology.orchestra.run.trial177.stderr:dumped monmap epoch 1 2026-02-13T03:43:18.385 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 systemd[1]: Starting Ceph mon.c for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 podman[27037]: 2026-02-13 03:43:18.406158991 +0000 UTC m=+0.017023795 container create 65a96c3cdf5da1d49c12b4ab0a2098f0511460135077dbf41841e9dc5297d3fc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-c, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True) 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 podman[27037]: 2026-02-13 03:43:18.440883555 +0000 UTC m=+0.051748349 container init 65a96c3cdf5da1d49c12b4ab0a2098f0511460135077dbf41841e9dc5297d3fc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-c, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, license=BSD-3-Clause, name=rockylinux, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 podman[27037]: 2026-02-13 03:43:18.443391501 +0000 UTC m=+0.054256305 container start 65a96c3cdf5da1d49c12b4ab0a2098f0511460135077dbf41841e9dc5297d3fc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-c, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, name=rockylinux, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 bash[27037]: 65a96c3cdf5da1d49c12b4ab0a2098f0511460135077dbf41841e9dc5297d3fc 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 podman[27037]: 2026-02-13 03:43:18.399327428 +0000 UTC m=+0.010192243 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 systemd[1]: Started Ceph mon.c for 0c5cf8b4-088e-11f1-b830-d404e6e7d460. 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: pidfile_write: ignore empty --pid-file 2026-02-13T03:43:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: load: jerasure load: lrc 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: RocksDB version: 7.9.2 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Git sha 0 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: DB SUMMARY 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: DB Session ID: EEI972HDCA9Y9U1E71G0 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: CURRENT file: CURRENT 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 519 ; 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.error_if_exists: 0 2026-02-13T03:43:18.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.create_if_missing: 0 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.paranoid_checks: 1 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.env: 0x55a7e0b882c0 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.info_log: 0x55a7e2becd60 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.statistics: (nil) 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.use_fsync: 0 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_log_file_size: 0 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T03:43:18.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T03:43:18.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T03:43:18.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T03:43:18.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.allow_fallocate: 1 2026-02-13T03:43:18.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T03:43:18.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T03:43:18.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.use_direct_reads: 0 2026-02-13T03:43:18.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T03:43:18.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T03:43:18.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.db_log_dir: 2026-02-13T03:43:18.707 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.wal_dir: 2026-02-13T03:43:18.707 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T03:43:18.707 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T03:43:18.707 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T03:43:18.707 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.write_buffer_manager: 0x55a7e2be3b80 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T03:43:18.708 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.unordered_write: 0 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.row_cache: None 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.wal_filter: None 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.two_write_queues: 0 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T03:43:18.709 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.wal_compression: 0 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.atomic_flush: 0 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.log_readahead_size: 0 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T03:43:18.710 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_background_jobs: 2 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_background_compactions: -1 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_subcompactions: 1 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_open_files: -1 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T03:43:18.711 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_background_flushes: -1 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Compression algorithms supported: 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: kZSTD supported: 0 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: kXpressCompression supported: 0 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: kBZip2Compression supported: 0 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: kLZ4Compression supported: 1 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: kZlibCompression supported: 1 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: kSnappyCompression supported: 1 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T03:43:18.712 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.merge_operator: 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_filter: None 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a7e2d6c360) 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout: cache_index_and_filter_blocks: 1 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T03:43:18.713 INFO:journalctl@ceph.mon.c.trial177.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: pin_top_level_index_and_filter: 1 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: index_type: 0 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: data_block_index_type: 0 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: index_shortening: 1 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: checksum: 4 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: no_block_cache: 0 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: block_cache: 0x55a7e2be5690 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: block_cache_name: BinnedLRUCache 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: block_cache_options: 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: capacity : 536870912 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: num_shard_bits : 4 2026-02-13T03:43:18.714 INFO:journalctl@ceph.mon.c.trial177.stdout: strict_capacity_limit : 0 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: high_pri_pool_ratio: 0.000 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: block_cache_compressed: (nil) 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: persistent_cache: (nil) 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: block_size: 4096 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: block_size_deviation: 10 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: block_restart_interval: 16 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: index_block_restart_interval: 1 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: metadata_block_size: 4096 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: partition_filters: 0 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: use_delta_encoding: 1 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: filter_policy: bloomfilter 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: whole_key_filtering: 1 2026-02-13T03:43:18.715 INFO:journalctl@ceph.mon.c.trial177.stdout: verify_compression: 0 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout: read_amp_bytes_per_bit: 0 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout: format_version: 5 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout: enable_index_compression: 1 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout: block_align: 0 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout: max_auto_readahead_size: 262144 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout: prepopulate_block_cache: 0 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout: initial_auto_readahead_size: 8192 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression: NoCompression 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T03:43:18.716 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.num_levels: 7 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T03:43:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T03:43:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T03:43:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T03:43:18.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.inplace_update_support: 0 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.bloom_locality: 0 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.max_successive_merges: 0 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T03:43:18.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.ttl: 2592000 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.enable_blob_files: false 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.min_blob_size: 0 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T03:43:18.722 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6c25ed12-855e-4616-92ae-0405bde852c6 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770954198460271, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770954198461613, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1655, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 531, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 409, "raw_average_value_size": 81, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770954198, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6c25ed12-855e-4616-92ae-0405bde852c6", "db_session_id": "EEI972HDCA9Y9U1E71G0", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770954198461672, "job": 1, "event": "recovery_finished"} 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a7e2c08e00 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: DB pointer 0x55a7e3a0e000 2026-02-13T03:43:18.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c does not exist in monmap, will attempt to join an existing cluster 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: ** DB Stats ** 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-13T03:43:18.724 INFO:journalctl@ceph.mon.c.trial177.stdout: ** Compaction Stats [default] ** 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: L0 1/0 1.62 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: Sum 1/0 1.62 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: ** Compaction Stats [default] ** 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-13T03:43:18.725 INFO:journalctl@ceph.mon.c.trial177.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: Cumulative compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: Interval compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: Block cache BinnedLRUCache@0x55a7e2be5690#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-02-13T03:43:18.726 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: using public_addr v2:10.20.193.177:0/0 -> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: starting mon.c rank -1 at public addrs [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] at bind addrs [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(???) e0 preinit fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).mds e1 new map 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).mds e1 print_map 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout: e1 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout: btime 2026-02-13T03:42:55:978956+0000 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout: legacy client fscid: -1 2026-02-13T03:43:18.727 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout: No filesystems configured 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).osd e3 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mkfs 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T03:43:18.728 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: monmap epoch 1 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: last_changed 2026-02-13T03:42:55.021029+0000 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: created 2026-02-13T03:42:55.021029+0000 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: min_mon_release 20 (tentacle) 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: election_strategy: 1 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: 0: [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] mon.a 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: fsmap 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mgrmap e1: no daemons active 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1475518328' entity='client.admin' 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2254975465' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T03:43:18.729 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: Activating manager daemon x 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mgrmap e2: x(active, starting, since 0.00245332s) 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: Manager daemon x is now available 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14100 10.20.193.70:0/3874871753' entity='mgr.x' 2026-02-13T03:43:18.730 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mgrmap e3: x(active, since 1.00459s) 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2669317323' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3077146810' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mgrmap e4: x(active, since 2s) 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/408395870' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/408395870' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mgrmap e5: x(active, since 3s) 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2268964805' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: Active manager daemon x restarted 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: Activating manager daemon x 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mgrmap e6: x(active, starting, since 0.00308704s) 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:43:18.731 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: Manager daemon x is now available 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:18.732 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mgrmap e7: x(active, since 1.00403s) 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1789130002' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: Optimize plan auto_2026-02-13_03:43:02, mode upmap, max misplaced 0.050000 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: No pools available 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: Found migration_current of "None". Setting to last migration. 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T03:43:18.733 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1789130002' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mgrmap e8: x(active, since 2s) 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial070", "addr": "10.20.193.70", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.734 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2798859671' entity='client.admin' 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2587230903' entity='client.admin' 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2615678397' entity='client.admin' 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.735 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial127", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial070", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:18.736 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial177", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.737 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial127", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2678480727' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.738 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2678480727' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial070:10.20.193.70=a;trial127:10.20.193.127=b;trial177:10.20.193.177=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/520648588' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:18.739 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:18.740 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:18.740 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:18 trial177 ceph-mon[27082]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T03:43:19.428 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:43:19.428 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:43:19.551 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:43:23.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:43:23.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: mon.a calling monitor election 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: mon.c calling monitor election 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: monmap epoch 2 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:23.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: last_changed 2026-02-13T03:43:18.477751+0000 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: created 2026-02-13T03:42:55.021029+0000 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: min_mon_release 20 (tentacle) 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: election_strategy: 1 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: 0: [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] mon.a 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: fsmap 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: mgrmap e8: x(active, since 21s) 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: overall HEALTH_OK 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:23.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:23.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:23.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:23.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:43:23.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: mon.a calling monitor election 2026-02-13T03:43:23.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: mon.c calling monitor election 2026-02-13T03:43:23.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:23.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: monmap epoch 2 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: last_changed 2026-02-13T03:43:18.477751+0000 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: created 2026-02-13T03:42:55.021029+0000 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: min_mon_release 20 (tentacle) 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: election_strategy: 1 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: 0: [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] mon.a 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: fsmap 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:43:23.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: mgrmap e8: x(active, since 21s) 2026-02-13T03:43:23.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: overall HEALTH_OK 2026-02-13T03:43:23.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:23.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:23.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:23.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:23.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:24.213 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:43:24.213 INFO:teuthology.orchestra.run.trial177.stdout:{"epoch":2,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","modified":"2026-02-13T03:43:18.477751Z","created":"2026-02-13T03:42:55.021029Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:3300","nonce":0},{"type":"v1","addr":"10.20.193.70:6789","nonce":0}]},"addr":"10.20.193.70:6789/0","public_addr":"10.20.193.70:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:42:55:021037+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:3300","nonce":0},{"type":"v1","addr":"10.20.193.177:6789","nonce":0}]},"addr":"10.20.193.177:6789/0","public_addr":"10.20.193.177:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:43:18:477749+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-13T03:43:24.213 INFO:teuthology.orchestra.run.trial177.stderr:dumped monmap epoch 2 2026-02-13T03:43:24.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:24 trial070 ceph-mon[24757]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:24.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:24 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/42494592' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:43:24.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:24 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:24.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:24 trial177 ceph-mon[27082]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:24.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:24 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/42494592' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:43:24.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:24 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:24.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:24 trial127 ceph-mon[26439]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T03:43:25.266 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:43:25.267 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:43:25.387 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:43:30.054 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:43:30.054 INFO:teuthology.orchestra.run.trial177.stdout:{"epoch":3,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","modified":"2026-02-13T03:43:24.755513Z","created":"2026-02-13T03:42:55.021029Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:3300","nonce":0},{"type":"v1","addr":"10.20.193.70:6789","nonce":0}]},"addr":"10.20.193.70:6789/0","public_addr":"10.20.193.70:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:42:55:021037+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:3300","nonce":0},{"type":"v1","addr":"10.20.193.177:6789","nonce":0}]},"addr":"10.20.193.177:6789/0","public_addr":"10.20.193.177:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:43:18:477749+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:3300","nonce":0},{"type":"v1","addr":"10.20.193.127:6789","nonce":0}]},"addr":"10.20.193.127:6789/0","public_addr":"10.20.193.127:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:43:24:755511+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-13T03:43:30.055 INFO:teuthology.orchestra.run.trial177.stderr:dumped monmap epoch 3 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: mon.a calling monitor election 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: mon.c calling monitor election 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: mon.b calling monitor election 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.066 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: monmap epoch 3 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: last_changed 2026-02-13T03:43:24.755513+0000 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: created 2026-02-13T03:42:55.021029+0000 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: min_mon_release 20 (tentacle) 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: election_strategy: 1 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: 0: [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] mon.a 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-13T03:43:30.067 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: 2: [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] mon.b 2026-02-13T03:43:30.068 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: fsmap 2026-02-13T03:43:30.068 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:43:30.068 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: mgrmap e8: x(active, since 27s) 2026-02-13T03:43:30.068 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: overall HEALTH_OK 2026-02-13T03:43:30.068 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.068 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.068 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.068 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.125 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-13T03:43:30.125 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-13T03:43:30.149 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:43:30.149 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: mon.a calling monitor election 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: mon.c calling monitor election 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: mon.b calling monitor election 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.150 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: monmap epoch 3 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: last_changed 2026-02-13T03:43:24.755513+0000 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: created 2026-02-13T03:42:55.021029+0000 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: min_mon_release 20 (tentacle) 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: election_strategy: 1 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: 0: [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] mon.a 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: 2: [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] mon.b 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: fsmap 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:43:30.151 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: mgrmap e8: x(active, since 27s) 2026-02-13T03:43:30.152 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: overall HEALTH_OK 2026-02-13T03:43:30.152 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.152 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.152 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.152 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.168 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:43:30.168 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.168 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: mon.a calling monitor election 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: mon.c calling monitor election 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: mon.b calling monitor election 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T03:43:30.169 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: monmap epoch 3 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: last_changed 2026-02-13T03:43:24.755513+0000 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: created 2026-02-13T03:42:55.021029+0000 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: min_mon_release 20 (tentacle) 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: election_strategy: 1 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: 0: [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] mon.a 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: 2: [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] mon.b 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: fsmap 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: mgrmap e8: x(active, since 27s) 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: overall HEALTH_OK 2026-02-13T03:43:30.170 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.171 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.171 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.171 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.244 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:30.457 INFO:teuthology.orchestra.run.trial070.stdout:# minimal ceph.conf for 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:30.457 INFO:teuthology.orchestra.run.trial070.stdout:[global] 2026-02-13T03:43:30.457 INFO:teuthology.orchestra.run.trial070.stdout: fsid = 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:43:30.457 INFO:teuthology.orchestra.run.trial070.stdout: mon_host = [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] 2026-02-13T03:43:30.516 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-13T03:43:30.517 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:43:30.517 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T03:43:30.583 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:43:30.583 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:43:30.648 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:43:30.649 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T03:43:30.678 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:43:30.678 DEBUG:teuthology.orchestra.run.trial127:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:43:30.741 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:43:30.741 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T03:43:30.769 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:43:30.769 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:43:30.833 INFO:tasks.cephadm:Adding mgr.x on trial070 2026-02-13T03:43:30.834 INFO:tasks.cephadm:Adding mgr.y on trial127 2026-02-13T03:43:30.834 INFO:tasks.cephadm:Adding mgr.z on trial177 2026-02-13T03:43:30.834 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch apply mgr '3;trial070=x;trial127=y;trial177=z' 2026-02-13T03:43:30.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:30.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:30.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='client.? 10.20.193.177:0/795001214' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:43:30.980 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.980 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.980 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.980 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.980 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:30.980 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2273016123' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:30.981 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:30 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:30.989 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:43:31.034 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:31.034 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:31.034 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/795001214' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:43:31.034 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2273016123' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.035 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.036 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.036 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:31.036 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:43:31.036 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:31.036 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:30 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:31.217 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled mgr update... 2026-02-13T03:43:31.258 DEBUG:teuthology.orchestra.run.trial127:mgr.y> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.y.service 2026-02-13T03:43:31.260 DEBUG:teuthology.orchestra.run.trial177:mgr.z> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.z.service 2026-02-13T03:43:31.263 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-13T03:43:31.263 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-13T03:43:31.265 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-13T03:43:31.266 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/795001214' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:31.286 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2273016123' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:31.287 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:30 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:43:31.288 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-13T03:43:31.288 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-13T03:43:31.332 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-13T03:43:31.332 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-13T03:43:31.375 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-13T03:43:31.375 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-13T03:43:31.382 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.383 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-13T03:43:31.383 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-13T03:43:31.402 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.403 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-13T03:43:31.403 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-13T03:43:31.446 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-13T03:43:31.446 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-13T03:43:31.452 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.453 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-13T03:43:31.453 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-13T03:43:31.496 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-13T03:43:31.497 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-13T03:43:31.498 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.514 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.516 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-13T03:43:31.516 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-13T03:43:31.579 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.579 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.579 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.620 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-13T03:43:31.620 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-13T03:43:31.629 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.630 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-13T03:43:31.630 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-13T03:43:31.670 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.672 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-13T03:43:31.672 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-13T03:43:31.699 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-13T03:43:31.699 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-13T03:43:31.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.705+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/368780098 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 msgr2=0x7fde4410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.705+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/368780098 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 0x7fde4410d040 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=15302001853633624243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde30009970 tx=0x7fde3002ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:31.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.705+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/368780098 shutdown_connections 2026-02-13T03:43:31.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.705+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/368780098 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde4410e780 0x7fde4416f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.705+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/368780098 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410ddd0 0x7fde4410e240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.705+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/368780098 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 0x7fde4410d040 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=15302001853633624243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.705+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/368780098 >> 10.20.193.70:0/368780098 conn(0x7fde440ea370 msgr2=0x7fde4410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.705+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/368780098 shutdown_connections 2026-02-13T03:43:31.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.705+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/368780098 wait complete. 2026-02-13T03:43:31.708 INFO:tasks.cephadm:setting config [mds] mds_use_global_snaprealm_seq_for_subvol = False 2026-02-13T03:43:31.709 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds mds_use_global_snaprealm_seq_for_subvol False 2026-02-13T03:43:31.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde4a6f36c0 1 Processor -- start 2026-02-13T03:43:31.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde4a6f36c0 1 -- start start 2026-02-13T03:43:31.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde4a6f36c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 0x7fde440f65e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 -- 10.20.193.70:0/1171466920 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c005ff30 msgr2=0x7f88c010b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.711 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 --2- 10.20.193.70:0/1171466920 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c005ff30 0x7f88c010b640 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=6720721491422727915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b0009970 tx=0x7f88b002ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:31.711 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 -- 10.20.193.70:0/1171466920 shutdown_connections 2026-02-13T03:43:31.711 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 --2- 10.20.193.70:0/1171466920 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88c010c530 0x7f88c010c9d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.711 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 --2- 10.20.193.70:0/1171466920 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88c010bb80 0x7f88c010bff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.711 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 --2- 10.20.193.70:0/1171466920 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c005ff30 0x7f88c010b640 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=6720721491422727915 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.711 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 -- 10.20.193.70:0/1171466920 >> 10.20.193.70:0/1171466920 conn(0x7f88c00e9220 msgr2=0x7f88c0109630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.711 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 -- 10.20.193.70:0/1171466920 shutdown_connections 2026-02-13T03:43:31.711 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 -- 10.20.193.70:0/1171466920 wait complete. 2026-02-13T03:43:31.712 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde43fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 0x7fde440f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.712 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde43fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 0x7fde440f65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43710/0 (socket says 10.20.193.70:43710) 2026-02-13T03:43:31.712 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde43fff6c0 1 -- 10.20.193.70:0/1495457486 learned_addr learned my addr 10.20.193.70:0/1495457486 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:31.712 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410ddd0 0x7fde4416f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.712 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde4410e780 0x7fde440f6e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.712 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde440f7a70 con 0x7fde4410cc50 2026-02-13T03:43:31.712 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.706+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fde440f7be0 con 0x7fde4410ddd0 2026-02-13T03:43:31.713 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 Processor -- start 2026-02-13T03:43:31.713 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 -- start start 2026-02-13T03:43:31.713 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88c005ff30 0x7f88c00f4f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.713 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88c010bb80 0x7f88c00f55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.713 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fde440f7da0 con 0x7fde4410e780 2026-02-13T03:43:31.714 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde437fe6c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410ddd0 0x7fde4416f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.714 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde43fff6c0 1 -- 10.20.193.70:0/1495457486 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde4410e780 msgr2=0x7fde440f6e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:43:31.714 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde43fff6c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde4410e780 0x7fde440f6e40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.714 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde43fff6c0 1 -- 10.20.193.70:0/1495457486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410ddd0 msgr2=0x7fde4416f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.714 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde43fff6c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410ddd0 0x7fde4416f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.714 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde43fff6c0 1 -- 10.20.193.70:0/1495457486 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde30009590 con 0x7fde4410cc50 2026-02-13T03:43:31.714 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde43fff6c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 0x7fde440f65e0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde3002f840 tx=0x7fde300028e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.714 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde417fa6c0 1 -- 10.20.193.70:0/1495457486 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde300046b0 con 0x7fde4410cc50 2026-02-13T03:43:31.715 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f8aeb38c6c0 1 -- 10.20.193.70:0/2627862641 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8ac003f8e0 msgr2=0x7f8ac005fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.715 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f8aeb38c6c0 1 --2- 10.20.193.70:0/2627862641 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8ac003f8e0 0x7f8ac005fd90 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ad4005980 tx=0x7f8ad4005910 comp rx=0 tx=0).stop 2026-02-13T03:43:31.715 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c010c530 0x7f88c00f61a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88c00f6930 con 0x7f88c010c530 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f88c00f6aa0 con 0x7f88c005ff30 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c73306c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f88c00f6c60 con 0x7f88c010bb80 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c58a66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c010c530 0x7f88c00f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c58a66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c010c530 0x7f88c00f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43722/0 (socket says 10.20.193.70:43722) 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c58a66c0 1 -- 10.20.193.70:0/3058323898 learned_addr learned my addr 10.20.193.70:0/3058323898 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c50a56c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88c005ff30 0x7f88c00f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f88c48a46c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88c010bb80 0x7f88c00f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c58a66c0 1 -- 10.20.193.70:0/3058323898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88c010bb80 msgr2=0x7f88c00f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c58a66c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88c010bb80 0x7f88c00f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c58a66c0 1 -- 10.20.193.70:0/3058323898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88c005ff30 msgr2=0x7f88c00f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.717 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c58a66c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88c005ff30 0x7f88c00f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.717 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c58a66c0 1 -- 10.20.193.70:0/3058323898 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b0009590 con 0x7f88c010c530 2026-02-13T03:43:31.717 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c48a46c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88c010bb80 0x7f88c00f55b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:43:31.717 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c50a56c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88c005ff30 0x7f88c00f4f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:43:31.717 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c58a66c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c010c530 0x7f88c00f61a0 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88bc00c6c0 tx=0x7f88bc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.717 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88ae7fc6c0 1 -- 10.20.193.70:0/3058323898 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88bc003a30 con 0x7f88c010c530 2026-02-13T03:43:31.717 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f8aeb38c6c0 1 -- 10.20.193.70:0/2627862641 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae410e780 msgr2=0x7f8ae40f6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.718 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7f8aeb38c6c0 1 --2- 10.20.193.70:0/2627862641 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae410e780 0x7f8ae40f6e40 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ae000ab70 tx=0x7f8ae00058a0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.718 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88ae7fc6c0 1 -- 10.20.193.70:0/3058323898 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(25 keys) ==== 1050+0+0 (secure 0 0 0) 0x7f88bc0054a0 con 0x7f88c010c530 2026-02-13T03:43:31.718 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88ae7fc6c0 1 -- 10.20.193.70:0/3058323898 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88bc00dbf0 con 0x7f88c010c530 2026-02-13T03:43:31.718 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c00f6f40 con 0x7f88c010c530 2026-02-13T03:43:31.718 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c00f7480 con 0x7f88c010c530 2026-02-13T03:43:31.719 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde417fa6c0 1 -- 10.20.193.70:0/1495457486 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(25 keys) ==== 1050+0+0 (secure 0 0 0) 0x7fde3002fe40 con 0x7fde4410cc50 2026-02-13T03:43:31.719 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde440f8020 con 0x7fde4410cc50 2026-02-13T03:43:31.719 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde417fa6c0 1 -- 10.20.193.70:0/1495457486 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde30007440 con 0x7fde4410cc50 2026-02-13T03:43:31.719 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c0175120 con 0x7f88c010c530 2026-02-13T03:43:31.720 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.707+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde440f84a0 con 0x7fde4410cc50 2026-02-13T03:43:31.720 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde44172d70 con 0x7fde4410cc50 2026-02-13T03:43:31.720 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.708+0000 7fde417fa6c0 1 -- 10.20.193.70:0/1495457486 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fde30031030 con 0x7fde4410cc50 2026-02-13T03:43:31.720 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7fde417fa6c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde1803f940 0x7fde1805fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.720 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7fde417fa6c0 1 -- 10.20.193.70:0/1495457486 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fde30075640 con 0x7fde4410cc50 2026-02-13T03:43:31.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f8aeb38c6c0 1 -- 10.20.193.70:0/2627862641 shutdown_connections 2026-02-13T03:43:31.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f8aeb38c6c0 1 --2- 10.20.193.70:0/2627862641 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8ac003f8e0 0x7f8ac005fd90 unknown :-1 s=CLOSED pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f8aeb38c6c0 1 --2- 10.20.193.70:0/2627862641 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae410e780 0x7f8ae40f6e40 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f8aeb38c6c0 1 --2- 10.20.193.70:0/2627862641 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ae410ddd0 0x7f8ae416f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f8aeb38c6c0 1 --2- 10.20.193.70:0/2627862641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ae410cc50 0x7f8ae40f65e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f8aeb38c6c0 1 -- 10.20.193.70:0/2627862641 >> 10.20.193.70:0/2627862641 conn(0x7f8ae40ea370 msgr2=0x7f8ae40ecb70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f8aeb38c6c0 1 -- 10.20.193.70:0/2627862641 shutdown_connections 2026-02-13T03:43:31.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f8aeb38c6c0 1 -- 10.20.193.70:0/2627862641 wait complete. 2026-02-13T03:43:31.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7fde437fe6c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde1803f940 0x7fde1805fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f88ae7fc6c0 1 -- 10.20.193.70:0/3058323898 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f88bc015060 con 0x7f88c010c530 2026-02-13T03:43:31.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f88ae7fc6c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f889c03f940 0x7f889c05fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f88ae7fc6c0 1 -- 10.20.193.70:0/3058323898 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f88bc0520c0 con 0x7f88c010c530 2026-02-13T03:43:31.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f88c50a56c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f889c03f940 0x7f889c05fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7fde437fe6c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde1803f940 0x7fde1805fdf0 secure :-1 s=READY pgs=52 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde34005980 tx=0x7fde34005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.709+0000 7f88c50a56c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f889c03f940 0x7f889c05fdf0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b00098c0 tx=0x7f88b00023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.711+0000 7fde417fa6c0 1 -- 10.20.193.70:0/1495457486 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fde30031820 con 0x7fde4410cc50 2026-02-13T03:43:31.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.712+0000 7f88ae7fc6c0 1 -- 10.20.193.70:0/3058323898 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88bc003d40 con 0x7f88c010c530 2026-02-13T03:43:31.725 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-13T03:43:31.725 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-13T03:43:31.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.756+0000 7fb41874c6c0 1 -- 10.20.193.70:0/1732154762 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb410174c10 con 0x7fb41010eed0 2026-02-13T03:43:31.759 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-13T03:43:31.759 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-13T03:43:31.761 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.759+0000 7fe7fc8ef6c0 1 -- 10.20.193.70:0/2410139882 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fe7f4172250 con 0x7fe7f412ddb0 2026-02-13T03:43:31.761 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.759+0000 7fb3f77fe6c0 1 -- 10.20.193.70:0/1732154762 <== mon.0 v2:10.20.193.70:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fb400008ab0 con 0x7fb41010eed0 2026-02-13T03:43:31.763 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T03:43:31.763 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-13T03:43:31.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.760+0000 7fe7df7fe6c0 1 -- 10.20.193.70:0/2410139882 <== mon.0 v2:10.20.193.70:3300/0 8 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7fe7e0031680 con 0x7fe7f412ddb0 2026-02-13T03:43:31.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.760+0000 7fb3f77fe6c0 1 -- 10.20.193.70:0/1732154762 <== mon.0 v2:10.20.193.70:3300/0 10 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7fb400022540 con 0x7fb41010eed0 2026-02-13T03:43:31.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.760+0000 7f57ee7fc6c0 1 -- 10.20.193.70:0/2392543583 <== mon.0 v2:10.20.193.70:3300/0 8 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7f57f4004f60 con 0x7f5800110050 2026-02-13T03:43:31.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.760+0000 7f88ae7fc6c0 1 -- 10.20.193.70:0/3058323898 <== mon.0 v2:10.20.193.70:3300/0 7 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7f88bc051a90 con 0x7f88c010c530 2026-02-13T03:43:31.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.760+0000 7fde417fa6c0 1 -- 10.20.193.70:0/1495457486 <== mon.0 v2:10.20.193.70:3300/0 7 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7fde30002e80 con 0x7fde4410cc50 2026-02-13T03:43:31.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.764+0000 7fe7df7fe6c0 1 -- 10.20.193.70:0/2410139882 <== mon.0 v2:10.20.193.70:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7fe7e0035890 con 0x7fe7f412ddb0 2026-02-13T03:43:31.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.763+0000 7fb41874c6c0 1 -- 10.20.193.70:0/1732154762 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3ec03f8f0 msgr2=0x7fb3ec05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.763+0000 7fb41874c6c0 1 --2- 10.20.193.70:0/1732154762 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3ec03f8f0 0x7fb3ec05fda0 secure :-1 s=READY pgs=49 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4040098c0 tx=0x7fb4040023a0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.763+0000 7fb41874c6c0 1 -- 10.20.193.70:0/1732154762 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb41010eed0 msgr2=0x7fb4100f8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.763+0000 7fb41874c6c0 1 --2- 10.20.193.70:0/1732154762 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb41010eed0 0x7fb4100f8910 secure :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb40000b6c0 tx=0x7fb40000bb90 comp rx=0 tx=0).stop 2026-02-13T03:43:31.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.764+0000 7f88ae7fc6c0 1 -- 10.20.193.70:0/3058323898 <== mon.0 v2:10.20.193.70:3300/0 8 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f88bc016e30 con 0x7f88c010c530 2026-02-13T03:43:31.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.764+0000 7f57ee7fc6c0 1 -- 10.20.193.70:0/2392543583 <== mon.0 v2:10.20.193.70:3300/0 9 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f57f4074020 con 0x7f5800110050 2026-02-13T03:43:31.768 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T03:43:31.768 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-13T03:43:31.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.764+0000 7fe7df7fe6c0 1 -- 10.20.193.70:0/2410139882 <== mon.0 v2:10.20.193.70:3300/0 10 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe7e0035890 con 0x7fe7f412ddb0 2026-02-13T03:43:31.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.766+0000 7fb41874c6c0 1 -- 10.20.193.70:0/1732154762 shutdown_connections 2026-02-13T03:43:31.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.766+0000 7fb41874c6c0 1 --2- 10.20.193.70:0/1732154762 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3ec03f8f0 0x7fb3ec05fda0 unknown :-1 s=CLOSED pgs=49 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.766+0000 7fb41874c6c0 1 --2- 10.20.193.70:0/1732154762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb410110a00 0x7fb4100f9170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.766+0000 7fb41874c6c0 1 --2- 10.20.193.70:0/1732154762 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb410110050 0x7fb410171390 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.766+0000 7fb41874c6c0 1 --2- 10.20.193.70:0/1732154762 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb41010eed0 0x7fb4100f8910 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.766+0000 7fb41874c6c0 1 -- 10.20.193.70:0/1732154762 >> 10.20.193.70:0/1732154762 conn(0x7fb4100ec5f0 msgr2=0x7fb4100eee40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.765+0000 7fde417fa6c0 1 -- 10.20.193.70:0/1495457486 <== mon.0 v2:10.20.193.70:3300/0 8 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fde30007e80 con 0x7fde4410cc50 2026-02-13T03:43:31.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.766+0000 7fb41874c6c0 1 -- 10.20.193.70:0/1732154762 shutdown_connections 2026-02-13T03:43:31.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.766+0000 7fb41874c6c0 1 -- 10.20.193.70:0/1732154762 wait complete. 2026-02-13T03:43:31.771 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 -- 10.20.193.70:0/2410139882 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe7d003f8f0 msgr2=0x7fe7d005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 --2- 10.20.193.70:0/2410139882 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe7d003f8f0 0x7fe7d005fda0 secure :-1 s=READY pgs=50 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7ec005980 tx=0x7fe7ec005910 comp rx=0 tx=0).stop 2026-02-13T03:43:31.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 -- 10.20.193.70:0/2410139882 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe7f412ddb0 msgr2=0x7fe7f41095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 --2- 10.20.193.70:0/2410139882 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe7f412ddb0 0x7fe7f41095d0 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7e00098c0 tx=0x7fe7e00046b0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.773 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-13T03:43:31.773 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-13T03:43:31.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 -- 10.20.193.70:0/2410139882 shutdown_connections 2026-02-13T03:43:31.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 --2- 10.20.193.70:0/2410139882 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe7d003f8f0 0x7fe7d005fda0 unknown :-1 s=CLOSED pgs=50 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 --2- 10.20.193.70:0/2410139882 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe7f414e930 0x7fe7f411c010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 --2- 10.20.193.70:0/2410139882 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe7f412ddb0 0x7fe7f41095d0 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 --2- 10.20.193.70:0/2410139882 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe7f405f7f0 0x7fe7f414e1b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 -- 10.20.193.70:0/2410139882 >> 10.20.193.70:0/2410139882 conn(0x7fe7f40e91f0 msgr2=0x7fe7f410b640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 -- 10.20.193.70:0/2410139882 shutdown_connections 2026-02-13T03:43:31.775 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.770+0000 7fe7fc8ef6c0 1 -- 10.20.193.70:0/2410139882 wait complete. 2026-02-13T03:43:31.786 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.788 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-13T03:43:31.788 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-13T03:43:31.832 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-13T03:43:31.832 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-13T03:43:31.833 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.834 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.831+0000 7f6cd25406c0 1 -- 10.20.193.70:0/443755350 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110a00 msgr2=0x7f6ccc171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.834 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.831+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/443755350 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110a00 0x7f6ccc171390 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=8767815528655578880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cc0006fd0 tx=0x7f6cc002ffd0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.834 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.832+0000 7f6cd25406c0 1 -- 10.20.193.70:0/443755350 shutdown_connections 2026-02-13T03:43:31.834 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.832+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/443755350 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110a00 0x7f6ccc171390 unknown :-1 s=CLOSED pgs=101 gs=2 cs=0 l=1 c_cookie=8767815528655578880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.834 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.832+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/443755350 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ccc110050 0x7f6ccc1104c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.835 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.832+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/443755350 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ccc10eed0 0x7f6ccc10f2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.835 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.832+0000 7f6cd25406c0 1 -- 10.20.193.70:0/443755350 >> 10.20.193.70:0/443755350 conn(0x7f6ccc0ec5f0 msgr2=0x7f6ccc10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.835 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.832+0000 7f6cd25406c0 1 -- 10.20.193.70:0/443755350 shutdown_connections 2026-02-13T03:43:31.835 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.832+0000 7f6cd25406c0 1 -- 10.20.193.70:0/443755350 wait complete. 2026-02-13T03:43:31.836 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-13T03:43:31.836 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-13T03:43:31.837 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.832+0000 7f6cd25406c0 1 Processor -- start 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.833+0000 7f6cd25406c0 1 -- start start 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.833+0000 7f6cd25406c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ccc10eed0 0x7f6ccc0f83d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.833+0000 7f6cd25406c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110050 0x7f6ccc171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.833+0000 7f6cd25406c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ccc110a00 0x7f6ccc0f8c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.833+0000 7f6cd25406c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0f9860 con 0x7f6ccc110050 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.833+0000 7f6cd25406c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0f99d0 con 0x7f6ccc110a00 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.833+0000 7f6cd25406c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0f9b90 con 0x7f6ccc10eed0 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.834+0000 7f6cd0ab66c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ccc110a00 0x7f6ccc0f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.834+0000 7f6ccb7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110050 0x7f6ccc171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.838 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.834+0000 7f6ccb7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110050 0x7f6ccc171370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43748/0 (socket says 10.20.193.70:43748) 2026-02-13T03:43:31.839 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.834+0000 7f6ccb7fe6c0 1 -- 10.20.193.70:0/1506049821 learned_addr learned my addr 10.20.193.70:0/1506049821 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:31.839 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.834+0000 7f6ccb7fe6c0 1 -- 10.20.193.70:0/1506049821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ccc10eed0 msgr2=0x7f6ccc0f83d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:43:31.839 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.834+0000 7f6ccb7fe6c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ccc10eed0 0x7f6ccc0f83d0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.839 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.834+0000 7f6ccb7fe6c0 1 -- 10.20.193.70:0/1506049821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ccc110a00 msgr2=0x7f6ccc0f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.840 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.834+0000 7f6ccb7fe6c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ccc110a00 0x7f6ccc0f8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.841 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.834+0000 7f6ccb7fe6c0 1 -- 10.20.193.70:0/1506049821 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc000a5b0 con 0x7f6ccc110050 2026-02-13T03:43:31.841 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.835+0000 7f6ccb7fe6c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110050 0x7f6ccc171370 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cbc00b710 tx=0x7f6cbc00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.841 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.835+0000 7f6cc97fa6c0 1 -- 10.20.193.70:0/1506049821 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cbc004250 con 0x7f6ccc110050 2026-02-13T03:43:31.841 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.835+0000 7f6cc97fa6c0 1 -- 10.20.193.70:0/1506049821 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6cbc009070 con 0x7f6ccc110050 2026-02-13T03:43:31.841 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.835+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ccc0f9e10 con 0x7f6ccc110050 2026-02-13T03:43:31.841 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.835+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ccc0fa340 con 0x7f6ccc110050 2026-02-13T03:43:31.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.835+0000 7f6cc97fa6c0 1 -- 10.20.193.70:0/1506049821 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cbc00ccd0 con 0x7f6ccc110050 2026-02-13T03:43:31.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.836+0000 7fe0201986c0 1 -- 10.20.193.70:0/3099406167 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe01810eeb0 msgr2=0x7fe01810f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.836+0000 7fe0201986c0 1 --2- 10.20.193.70:0/3099406167 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe01810eeb0 0x7fe01810f2a0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=8834192871418975933 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe008009970 tx=0x7fe00802ed50 comp rx=0 tx=0).stop 2026-02-13T03:43:31.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.836+0000 7f6cc97fa6c0 1 -- 10.20.193.70:0/1506049821 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f6cbc0071c0 con 0x7f6ccc110050 2026-02-13T03:43:31.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.836+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ccc1752c0 con 0x7f6ccc110050 2026-02-13T03:43:31.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.836+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fde4410e240 con 0x7fde4410cc50 2026-02-13T03:43:31.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.837+0000 7f6cc97fa6c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6ca003f8f0 0x7f6ca005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.837+0000 7f6cc97fa6c0 1 -- 10.20.193.70:0/1506049821 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f6cbc052290 con 0x7f6ccc110050 2026-02-13T03:43:31.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 -- 10.20.193.70:0/3099406167 shutdown_connections 2026-02-13T03:43:31.845 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 --2- 10.20.193.70:0/3099406167 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0181109e0 0x7fe018171370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.845 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 --2- 10.20.193.70:0/3099406167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 0x7fe0181104a0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.845 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 --2- 10.20.193.70:0/3099406167 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe01810eeb0 0x7fe01810f2a0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=8834192871418975933 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.845 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 -- 10.20.193.70:0/3099406167 >> 10.20.193.70:0/3099406167 conn(0x7fe0180ec5f0 msgr2=0x7fe01810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.845 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 -- 10.20.193.70:0/3099406167 shutdown_connections 2026-02-13T03:43:31.845 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7f6ccbfff6c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6ca003f8f0 0x7f6ca005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 -- 10.20.193.70:0/3099406167 wait complete. 2026-02-13T03:43:31.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 Processor -- start 2026-02-13T03:43:31.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7f6ccbfff6c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6ca003f8f0 0x7f6ca005fda0 secure :-1 s=READY pgs=55 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cb8005b40 tx=0x7f6cb80073d0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 -- start start 2026-02-13T03:43:31.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe01810eeb0 0x7fe0180ee980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 0x7fe018171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.838+0000 7fe0201986c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0181109e0 0x7fe0180ef1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe0201986c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0180efe10 con 0x7fe0181109e0 2026-02-13T03:43:31.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe0201986c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe0180eff80 con 0x7fe01810eeb0 2026-02-13T03:43:31.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe0201986c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0180f0140 con 0x7fe018110030 2026-02-13T03:43:31.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01d70c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 0x7fe018171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01e70e6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0181109e0 0x7fe0180ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01d70c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 0x7fe018171370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:35232/0 (socket says 10.20.193.70:35232) 2026-02-13T03:43:31.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01d70c6c0 1 -- 10.20.193.70:0/4070933272 learned_addr learned my addr 10.20.193.70:0/4070933272 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:31.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01df0d6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe01810eeb0 0x7fe0180ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01d70c6c0 1 -- 10.20.193.70:0/4070933272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 msgr2=0x7fe018171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:43:31.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7f6cc97fa6c0 1 -- 10.20.193.70:0/1506049821 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6cbc014250 con 0x7f6ccc110050 2026-02-13T03:43:31.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01d70c6c0 1 -- 10.20.193.70:0/4070933272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 msgr2=0x7fe018171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:31.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01d70c6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 0x7fe018171370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:31.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01d70c6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 0x7fe018171370 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:31.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01df0d6c0 1 -- 10.20.193.70:0/4070933272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe01810eeb0 msgr2=0x7fe0180ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T03:43:31.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01df0d6c0 1 -- 10.20.193.70:0/4070933272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe01810eeb0 msgr2=0x7fe0180ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:31.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01df0d6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe01810eeb0 0x7fe0180ee980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:31.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01df0d6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe01810eeb0 0x7fe0180ee980 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:31.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01e70e6c0 1 -- 10.20.193.70:0/4070933272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 msgr2=0x7fe018171370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01e70e6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 0x7fe018171370 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01e70e6c0 1 -- 10.20.193.70:0/4070933272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe01810eeb0 msgr2=0x7fe0180ee980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01e70e6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe01810eeb0 0x7fe0180ee980 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01e70e6c0 1 -- 10.20.193.70:0/4070933272 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe008009590 con 0x7fe0181109e0 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.839+0000 7fe01e70e6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0181109e0 0x7fe0180ef1e0 secure :-1 s=READY pgs=104 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe01400c6c0 tx=0x7fe01400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.840+0000 7fe006ffd6c0 1 -- 10.20.193.70:0/4070933272 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe014005340 con 0x7fe0181109e0 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.840+0000 7fe006ffd6c0 1 -- 10.20.193.70:0/4070933272 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe01401ece0 con 0x7fe0181109e0 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.840+0000 7fe006ffd6c0 1 -- 10.20.193.70:0/4070933272 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe014008520 con 0x7fe0181109e0 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.840+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0180f0420 con 0x7fe0181109e0 2026-02-13T03:43:31.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.840+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0180f0820 con 0x7fe0181109e0 2026-02-13T03:43:31.852 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T03:43:31.852 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T03:43:31.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.841+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0181752a0 con 0x7fe0181109e0 2026-02-13T03:43:31.854 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.842+0000 7fde417fa6c0 1 -- 10.20.193.70:0/1495457486 <== mon.0 v2:10.20.193.70:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v14)=0 v14) ==== 106+0+0 (secure 0 0 0) 0x7fde300393b0 con 0x7fde4410cc50 2026-02-13T03:43:31.854 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.843+0000 7f58079d36c0 1 -- 10.20.193.70:0/2392543583 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f5800174610 con 0x7f5800110050 2026-02-13T03:43:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.845+0000 7fe006ffd6c0 1 -- 10.20.193.70:0/4070933272 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fe0140054a0 con 0x7fe0181109e0 2026-02-13T03:43:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.845+0000 7fe006ffd6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdff403f8c0 0x7fdff405fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.845+0000 7fe006ffd6c0 1 -- 10.20.193.70:0/4070933272 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fe0140635a0 con 0x7fe0181109e0 2026-02-13T03:43:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.845+0000 7fe01df0d6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdff403f8c0 0x7fdff405fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.846+0000 7fe01df0d6c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdff403f8c0 0x7fdff405fd70 secure :-1 s=READY pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0080092e0 tx=0x7fe008005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.847+0000 7fe006ffd6c0 1 -- 10.20.193.70:0/4070933272 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe01401f6b0 con 0x7fe0181109e0 2026-02-13T03:43:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.849+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde1803f940 msgr2=0x7fde1805fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.849+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde1803f940 0x7fde1805fdf0 secure :-1 s=READY pgs=52 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde34005980 tx=0x7fde34005910 comp rx=0 tx=0).stop 2026-02-13T03:43:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.849+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 msgr2=0x7fde440f65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.849+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 0x7fde440f65e0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde3002f840 tx=0x7fde300028e0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.849+0000 7f57ee7fc6c0 1 -- 10.20.193.70:0/2392543583 <== mon.0 v2:10.20.193.70:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7f57f4038060 con 0x7f5800110050 2026-02-13T03:43:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.849+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f88c010b640 con 0x7f88c010c530 2026-02-13T03:43:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.850+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 shutdown_connections 2026-02-13T03:43:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.850+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde1803f940 0x7fde1805fdf0 unknown :-1 s=CLOSED pgs=52 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.850+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde4410e780 0x7fde440f6e40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.850+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410ddd0 0x7fde4416f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.850+0000 7fde4a6f36c0 1 --2- 10.20.193.70:0/1495457486 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410cc50 0x7fde440f65e0 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.850+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 >> 10.20.193.70:0/1495457486 conn(0x7fde440ea370 msgr2=0x7fde440ecb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.850+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 shutdown_connections 2026-02-13T03:43:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.850+0000 7fde4a6f36c0 1 -- 10.20.193.70:0/1495457486 wait complete. 2026-02-13T03:43:31.859 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 -- 10.20.193.70:0/2392543583 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f57dc03f940 msgr2=0x7f57dc05fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 --2- 10.20.193.70:0/2392543583 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f57dc03f940 0x7f57dc05fdf0 secure :-1 s=READY pgs=51 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57f0005980 tx=0x7f57f0005910 comp rx=0 tx=0).stop 2026-02-13T03:43:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 -- 10.20.193.70:0/2392543583 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5800110050 msgr2=0x7f5800171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 --2- 10.20.193.70:0/2392543583 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5800110050 0x7f5800171390 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57f40092b0 tx=0x7f57f40046b0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 -- 10.20.193.70:0/2392543583 shutdown_connections 2026-02-13T03:43:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 --2- 10.20.193.70:0/2392543583 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f57dc03f940 0x7f57dc05fdf0 unknown :-1 s=CLOSED pgs=51 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 --2- 10.20.193.70:0/2392543583 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5800110a00 0x7f58000f9180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 --2- 10.20.193.70:0/2392543583 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5800110050 0x7f5800171390 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 --2- 10.20.193.70:0/2392543583 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f580010eed0 0x7f58000f8920 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 -- 10.20.193.70:0/2392543583 >> 10.20.193.70:0/2392543583 conn(0x7f58000ec5f0 msgr2=0x7f58000eed60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 -- 10.20.193.70:0/2392543583 shutdown_connections 2026-02-13T03:43:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.853+0000 7f58079d36c0 1 -- 10.20.193.70:0/2392543583 wait complete. 2026-02-13T03:43:31.861 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.856+0000 7f88ae7fc6c0 1 -- 10.20.193.70:0/3058323898 <== mon.0 v2:10.20.193.70:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v16)=0 v16) ==== 117+0+0 (secure 0 0 0) 0x7f88bc003d40 con 0x7f88c010c530 2026-02-13T03:43:31.861 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-13T03:43:31.861 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-13T03:43:31.864 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.862+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f889c03f940 msgr2=0x7f889c05fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.864 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.862+0000 7f88c73306c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f889c03f940 0x7f889c05fdf0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b00098c0 tx=0x7f88b00023a0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.864 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.862+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c010c530 msgr2=0x7f88c00f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.864 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.862+0000 7f88c73306c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c010c530 0x7f88c00f61a0 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88bc00c6c0 tx=0x7f88bc00cb90 comp rx=0 tx=0).stop 2026-02-13T03:43:31.866 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-13T03:43:31.866 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-13T03:43:31.867 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.863+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 shutdown_connections 2026-02-13T03:43:31.867 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.863+0000 7f88c73306c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f889c03f940 0x7f889c05fdf0 unknown :-1 s=CLOSED pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.867 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.863+0000 7f88c73306c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f88c010c530 0x7f88c00f61a0 unknown :-1 s=CLOSED pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.868 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.863+0000 7f88c73306c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88c010bb80 0x7f88c00f55b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.868 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.863+0000 7f88c73306c0 1 --2- 10.20.193.70:0/3058323898 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f88c005ff30 0x7f88c00f4f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.868 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.863+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 >> 10.20.193.70:0/3058323898 conn(0x7f88c00e9220 msgr2=0x7f88c00eafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.868 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.864+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 shutdown_connections 2026-02-13T03:43:31.868 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.864+0000 7f88c73306c0 1 -- 10.20.193.70:0/3058323898 wait complete. 2026-02-13T03:43:31.883 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.885 DEBUG:tasks.cephadm:set 27 configs 2026-02-13T03:43:31.885 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial070') 2026-02-13T03:43:31.885 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial070') 2026-02-13T03:43:31.886 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial070') 2026-02-13T03:43:31.886 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial070') 2026-02-13T03:43:31.886 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial070') 2026-02-13T03:43:31.886 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial070') 2026-02-13T03:43:31.923 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.944 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.958 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.961 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.960+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/1748238404 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5741137a0 msgr2=0x7fc574113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.960+0000 7fc57a19b6c0 1 --2- 10.20.193.70:0/1748238404 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5741137a0 0x7fc574113b90 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=13000041096812798783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc564009970 tx=0x7fc56402ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:31.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.960+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/1748238404 shutdown_connections 2026-02-13T03:43:31.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.960+0000 7fc57a19b6c0 1 --2- 10.20.193.70:0/1748238404 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc574114cb0 0x7fc5741757c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.960+0000 7fc57a19b6c0 1 --2- 10.20.193.70:0/1748238404 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc574114120 0x7fc574114570 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.960+0000 7fc57a19b6c0 1 --2- 10.20.193.70:0/1748238404 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5741137a0 0x7fc574113b90 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=13000041096812798783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.960+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/1748238404 >> 10.20.193.70:0/1748238404 conn(0x7fc574064120 msgr2=0x7fc574064540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.961+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/1748238404 shutdown_connections 2026-02-13T03:43:31.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.961+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/1748238404 wait complete. 2026-02-13T03:43:31.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.961+0000 7fc57a19b6c0 1 Processor -- start 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.961+0000 7fc57a19b6c0 1 -- start start 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc57a19b6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 0x7fc5740fe830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc57a19b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc574114120 0x7fc5741757c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc5791996c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 0x7fc5740fe830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc5791996c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 0x7fc5740fe830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:35236/0 (socket says 10.20.193.70:35236) 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc57a19b6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc574114cb0 0x7fc5740ff090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc5789986c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc574114120 0x7fc5741757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc5789986c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc574114120 0x7fc5741757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43786/0 (socket says 10.20.193.70:43786) 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc5791996c0 1 -- 10.20.193.70:0/2039414024 learned_addr learned my addr 10.20.193.70:0/2039414024 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/2039414024 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740ffcc0 con 0x7fc574114120 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/2039414024 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740ffe30 con 0x7fc574114cb0 2026-02-13T03:43:31.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/2039414024 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740ffff0 con 0x7fc5741137a0 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.962+0000 7fc57999a6c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc574114cb0 0x7fc5740ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5791996c0 1 -- 10.20.193.70:0/2039414024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 msgr2=0x7fc5740fe830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5791996c0 1 -- 10.20.193.70:0/2039414024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 msgr2=0x7fc5740fe830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5791996c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 0x7fc5740fe830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5791996c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 0x7fc5740fe830 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5789986c0 1 -- 10.20.193.70:0/2039414024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 msgr2=0x7fc5740fe830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5789986c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 0x7fc5740fe830 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5789986c0 1 -- 10.20.193.70:0/2039414024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc574114cb0 msgr2=0x7fc5740ff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5789986c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc574114cb0 0x7fc5740ff090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5789986c0 1 -- 10.20.193.70:0/2039414024 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc564009590 con 0x7fc574114120 2026-02-13T03:43:31.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5789986c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc574114120 0x7fc5741757c0 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc56800b6c0 tx=0x7fc56800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.970 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5627fc6c0 1 -- 10.20.193.70:0/2039414024 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc568004250 con 0x7fc574114120 2026-02-13T03:43:31.970 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5627fc6c0 1 -- 10.20.193.70:0/2039414024 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc568004d20 con 0x7fc574114120 2026-02-13T03:43:31.970 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/2039414024 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5741002d0 con 0x7fc574114120 2026-02-13T03:43:31.970 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.963+0000 7fc5627fc6c0 1 -- 10.20.193.70:0/2039414024 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc568002930 con 0x7fc574114120 2026-02-13T03:43:31.970 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.964+0000 7fc57a19b6c0 1 -- 10.20.193.70:0/2039414024 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc574100800 con 0x7fc574114120 2026-02-13T03:43:31.970 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.964+0000 7fc543fff6c0 1 -- 10.20.193.70:0/2039414024 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc538005310 con 0x7fc574114120 2026-02-13T03:43:31.970 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:31.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.973+0000 7fc5627fc6c0 1 -- 10.20.193.70:0/2039414024 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fc5680043b0 con 0x7fc574114120 2026-02-13T03:43:31.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.974+0000 7fc5627fc6c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc55003f8f0 0x7fc55005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.974+0000 7fc5627fc6c0 1 -- 10.20.193.70:0/2039414024 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fc568051190 con 0x7fc574114120 2026-02-13T03:43:31.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.974+0000 7fc5627fc6c0 1 -- 10.20.193.70:0/2039414024 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc5680536b0 con 0x7fc574114120 2026-02-13T03:43:31.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.974+0000 7fc5791996c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc55003f8f0 0x7fc55005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.980 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.979+0000 7fc5791996c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc55003f8f0 0x7fc55005fda0 secure :-1 s=READY pgs=57 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc564005b40 tx=0x7fc564005de0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial070') 2026-02-13T03:43:31.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial070') 2026-02-13T03:43:31.983 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial070') 2026-02-13T03:43:31.984 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.982+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1454984818 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f874410cc70 msgr2=0x7f874410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.982+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1454984818 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f874410cc70 0x7f874410d0e0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=16431567530399171362 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87300098a0 tx=0x7f873002ec40 comp rx=0 tx=0).stop 2026-02-13T03:43:31.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.982+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1454984818 shutdown_connections 2026-02-13T03:43:31.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.982+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1454984818 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f874410d620 0x7f874416dfb0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.982+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1454984818 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f874410cc70 0x7f874410d0e0 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=16431567530399171362 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.982+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1454984818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f874410baf0 0x7f874410bee0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.982+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1454984818 >> 10.20.193.70:0/1454984818 conn(0x7f87440e91f0 msgr2=0x7f8744109620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.983+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1454984818 shutdown_connections 2026-02-13T03:43:31.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1454984818 wait complete. 2026-02-13T03:43:31.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f8749c6c6c0 1 Processor -- start 2026-02-13T03:43:31.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f6ccc0f0e10 con 0x7f6ccc110050 2026-02-13T03:43:31.987 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f8749c6c6c0 1 -- start start 2026-02-13T03:43:31.987 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f8749c6c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f874410baf0 0x7f874411c380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f8749c6c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f874410cc70 0x7f874411c9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f8749c6c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f874410d620 0x7f874411d5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f8749c6c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f874411dd50 con 0x7f874410cc70 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f8749c6c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f874411de90 con 0x7f874410d620 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.984+0000 7f8749c6c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f874411e050 con 0x7f874410baf0 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f8742ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f874410cc70 0x7f874411c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f87437fe6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f874410baf0 0x7f874411c380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f87437fe6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f874410baf0 0x7f874411c380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:35246/0 (socket says 10.20.193.70:35246) 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f87437fe6c0 1 -- 10.20.193.70:0/1644767183 learned_addr learned my addr 10.20.193.70:0/1644767183 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f8742ffd6c0 1 -- 10.20.193.70:0/1644767183 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f874410baf0 msgr2=0x7f874411c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f8742ffd6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f874410baf0 0x7f874411c380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f8742ffd6c0 1 -- 10.20.193.70:0/1644767183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f874410d620 msgr2=0x7f874411d5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:31.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f8742ffd6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f874410d620 0x7f874411d5c0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f8742ffd6c0 1 -- 10.20.193.70:0/1644767183 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87300094c0 con 0x7f874410cc70 2026-02-13T03:43:31.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.985+0000 7f8742ffd6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f874410cc70 0x7f874411c9d0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f873002f150 tx=0x7f8730004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:31.990 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.989+0000 7f6cc97fa6c0 1 -- 10.20.193.70:0/1506049821 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 127+0+0 (secure 0 0 0) 0x7f6cbc011540 con 0x7f6ccc110050 2026-02-13T03:43:31.990 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.989+0000 7f8740ff96c0 1 -- 10.20.193.70:0/1644767183 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8730002ae0 con 0x7f874410cc70 2026-02-13T03:43:31.992 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.989+0000 7f8740ff96c0 1 -- 10.20.193.70:0/1644767183 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8730002c40 con 0x7f874410cc70 2026-02-13T03:43:31.992 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.989+0000 7f8740ff96c0 1 -- 10.20.193.70:0/1644767183 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87300312b0 con 0x7f874410cc70 2026-02-13T03:43:31.992 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.989+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874411e2d0 con 0x7f874410cc70 2026-02-13T03:43:31.992 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.989+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8744113730 con 0x7f874410cc70 2026-02-13T03:43:31.992 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.990+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8744059550 con 0x7f874410cc70 2026-02-13T03:43:31.996 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.994+0000 7f8740ff96c0 1 -- 10.20.193.70:0/1644767183 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f87300071c0 con 0x7f874410cc70 2026-02-13T03:43:31.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f8740ff96c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f871003f870 0x7f871005fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:31.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f8740ff96c0 1 -- 10.20.193.70:0/1644767183 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f8730075370 con 0x7f874410cc70 2026-02-13T03:43:31.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f8740ff96c0 1 -- 10.20.193.70:0/1644767183 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8730075700 con 0x7f874410cc70 2026-02-13T03:43:31.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f87437fe6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f871003f870 0x7f871005fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:31.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.994+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6ca003f8f0 msgr2=0x7f6ca005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.994+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6ca003f8f0 0x7f6ca005fda0 secure :-1 s=READY pgs=55 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cb8005b40 tx=0x7f6cb80073d0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.994+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110050 msgr2=0x7f6ccc171370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:31.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.994+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110050 0x7f6ccc171370 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cbc00b710 tx=0x7f6cbc00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 shutdown_connections 2026-02-13T03:43:31.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6ca003f8f0 0x7f6ca005fda0 unknown :-1 s=CLOSED pgs=55 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ccc110a00 0x7f6ccc0f8c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ccc110050 0x7f6ccc171370 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f6cd25406c0 1 --2- 10.20.193.70:0/1506049821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ccc10eed0 0x7f6ccc0f83d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:31.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 >> 10.20.193.70:0/1506049821 conn(0x7f6ccc0ec5f0 msgr2=0x7f6ccc0ee4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:31.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 shutdown_connections 2026-02-13T03:43:31.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.995+0000 7f6cd25406c0 1 -- 10.20.193.70:0/1506049821 wait complete. 2026-02-13T03:43:31.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:31.997+0000 7f87437fe6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f871003f870 0x7f871005fd20 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8734007240 tx=0x7f8734007640 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.002 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:32.009 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.007+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fe01810f280 con 0x7fe0181109e0 2026-02-13T03:43:32.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.010+0000 7fe006ffd6c0 1 -- 10.20.193.70:0/4070933272 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7fe014022060 con 0x7fe0181109e0 2026-02-13T03:43:32.013 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.012+0000 7f9b25d936c0 1 -- 10.20.193.70:0/539681771 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010cc50 msgr2=0x7f9b2010d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.012+0000 7f9b25d936c0 1 --2- 10.20.193.70:0/539681771 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010cc50 0x7f9b2010d040 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=674300723965267707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b0c009970 tx=0x7f9b0c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:32.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.013+0000 7f9b25d936c0 1 -- 10.20.193.70:0/539681771 shutdown_connections 2026-02-13T03:43:32.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.013+0000 7f9b25d936c0 1 --2- 10.20.193.70:0/539681771 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b2010e780 0x7f9b2016f110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.013+0000 7f9b25d936c0 1 --2- 10.20.193.70:0/539681771 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2010ddd0 0x7f9b2010e240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.013+0000 7f9b25d936c0 1 --2- 10.20.193.70:0/539681771 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010cc50 0x7f9b2010d040 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=674300723965267707 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.013+0000 7f9b25d936c0 1 -- 10.20.193.70:0/539681771 >> 10.20.193.70:0/539681771 conn(0x7f9b200ea370 msgr2=0x7f9b2010a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.013+0000 7f9b25d936c0 1 -- 10.20.193.70:0/539681771 shutdown_connections 2026-02-13T03:43:32.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b25d936c0 1 -- 10.20.193.70:0/539681771 wait complete. 2026-02-13T03:43:32.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b25d936c0 1 Processor -- start 2026-02-13T03:43:32.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b25d936c0 1 -- start start 2026-02-13T03:43:32.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b25d936c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b2010cc50 0x7f9b20057260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b25d936c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010ddd0 0x7f9b2016f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b25d936c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2010e780 0x7f9b20057ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b25d936c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b200586f0 con 0x7f9b2010ddd0 2026-02-13T03:43:32.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b25d936c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20058860 con 0x7f9b2010cc50 2026-02-13T03:43:32.018 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b25d936c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20058a20 con 0x7f9b2010e780 2026-02-13T03:43:32.018 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b1effd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010ddd0 0x7f9b2016f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.018 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.014+0000 7f9b1effd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010ddd0 0x7f9b2016f110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43820/0 (socket says 10.20.193.70:43820) 2026-02-13T03:43:32.018 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1effd6c0 1 -- 10.20.193.70:0/3514082016 learned_addr learned my addr 10.20.193.70:0/3514082016 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.018 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdff403f8c0 msgr2=0x7fdff405fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.018 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7fe0201986c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdff403f8c0 0x7fdff405fd70 secure :-1 s=READY pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0080092e0 tx=0x7fe008005c00 comp rx=0 tx=0).stop 2026-02-13T03:43:32.018 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0181109e0 msgr2=0x7fe0180ef1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.018 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7fe0201986c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0181109e0 0x7fe0180ef1e0 secure :-1 s=READY pgs=104 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe01400c6c0 tx=0x7fe01400cb90 comp rx=0 tx=0).stop 2026-02-13T03:43:32.020 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1ffff6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2010e780 0x7f9b20057ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.020 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1f7fe6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b2010cc50 0x7f9b20057260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.020 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1effd6c0 1 -- 10.20.193.70:0/3514082016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2010e780 msgr2=0x7f9b20057ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1effd6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2010e780 0x7f9b20057ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1effd6c0 1 -- 10.20.193.70:0/3514082016 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b2010cc50 msgr2=0x7f9b20057260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1effd6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b2010cc50 0x7f9b20057260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1effd6c0 1 -- 10.20.193.70:0/3514082016 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c009590 con 0x7f9b2010ddd0 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1f7fe6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b2010cc50 0x7f9b20057260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1effd6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010ddd0 0x7f9b2016f110 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b1000b710 tx=0x7f9b1000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1cff96c0 1 -- 10.20.193.70:0/3514082016 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b10004250 con 0x7f9b2010ddd0 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b25d936c0 1 -- 10.20.193.70:0/3514082016 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b20058d00 con 0x7f9b2010ddd0 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b25d936c0 1 -- 10.20.193.70:0/3514082016 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b20059230 con 0x7f9b2010ddd0 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1cff96c0 1 -- 10.20.193.70:0/3514082016 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9b10009070 con 0x7f9b2010ddd0 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.015+0000 7f9b1cff96c0 1 -- 10.20.193.70:0/3514082016 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b1000cc30 con 0x7f9b2010ddd0 2026-02-13T03:43:32.021 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7f9afa7fc6c0 1 -- 10.20.193.70:0/3514082016 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae8005310 con 0x7f9b2010ddd0 2026-02-13T03:43:32.022 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7f9b1cff96c0 1 -- 10.20.193.70:0/3514082016 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f9b100028c0 con 0x7f9b2010ddd0 2026-02-13T03:43:32.022 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7f9b1cff96c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9af403f8f0 0x7f9af405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.022 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7f9b1cff96c0 1 -- 10.20.193.70:0/3514082016 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f9b10051470 con 0x7f9b2010ddd0 2026-02-13T03:43:32.022 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7f9b1f7fe6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9af403f8f0 0x7f9af405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.022 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 shutdown_connections 2026-02-13T03:43:32.022 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7fe0201986c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdff403f8c0 0x7fdff405fd70 unknown :-1 s=CLOSED pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.022 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7fe0201986c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0181109e0 0x7fe0180ef1e0 unknown :-1 s=CLOSED pgs=104 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.022 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7fe0201986c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe018110030 0x7fe018171370 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.022 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7fe0201986c0 1 --2- 10.20.193.70:0/4070933272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe01810eeb0 0x7fe0180ee980 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.023 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.016+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 >> 10.20.193.70:0/4070933272 conn(0x7fe0180ec5f0 msgr2=0x7fe018063950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.023 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.017+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 shutdown_connections 2026-02-13T03:43:32.023 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.017+0000 7f9b1f7fe6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9af403f8f0 0x7f9af405fda0 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b0c02f230 tx=0x7f9b0c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.023 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.018+0000 7fe0201986c0 1 -- 10.20.193.70:0/4070933272 wait complete. 2026-02-13T03:43:32.024 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.018+0000 7f9b1cff96c0 1 -- 10.20.193.70:0/3514082016 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9b1000fe40 con 0x7f9b2010ddd0 2026-02-13T03:43:32.030 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:32.036 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:32.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:32.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:43:32.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial070=x;trial127=y;trial177=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:32.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1467923666' entity='client.admin' 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3466133876' entity='client.admin' 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2627862641' entity='client.admin' 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1732154762' entity='client.admin' 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2410139882' entity='client.admin' 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.042 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1495457486' entity='client.admin' 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2392543583' entity='client.admin' 2026-02-13T03:43:32.043 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:31 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3058323898' entity='client.admin' 2026-02-13T03:43:32.050 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:32.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.057+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/1178904288 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410bb50 msgr2=0x7fc27410bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.057+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/1178904288 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410bb50 0x7fc27410bfc0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=12597416491169837456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc27000aa40 tx=0x7fc27002fde0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.057+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/1178904288 shutdown_connections 2026-02-13T03:43:32.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.057+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/1178904288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc27410c500 0x7fc27410ce40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.057+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/1178904288 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410bb50 0x7fc27410bfc0 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=12597416491169837456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.057+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/1178904288 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc27410aa90 0x7fc27410ae80 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.057+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/1178904288 >> 10.20.193.70:0/1178904288 conn(0x7fc2740e8510 msgr2=0x7fc274108940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.058+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/1178904288 shutdown_connections 2026-02-13T03:43:32.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.061+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/1178904288 wait complete. 2026-02-13T03:43:32.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.061+0000 7fc27c7c96c0 1 Processor -- start 2026-02-13T03:43:32.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.061+0000 7fc27c7c96c0 1 -- start start 2026-02-13T03:43:32.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.061+0000 7fc27c7c96c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc27410aa90 0x7fc2740fba50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.061+0000 7fc27c7c96c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc27410bb50 0x7fc2740fc0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.061+0000 7fc27c7c96c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410c500 0x7fc2740fcc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.061+0000 7fc27c7c96c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740fd3d0 con 0x7fc27410c500 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.061+0000 7fc27c7c96c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740fd510 con 0x7fc27410aa90 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.061+0000 7fc27c7c96c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2740fd6d0 con 0x7fc27410bb50 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27ad3b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410c500 0x7fc2740fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27ad3b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410c500 0x7fc2740fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43840/0 (socket says 10.20.193.70:43840) 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27ad3b6c0 1 -- 10.20.193.70:0/3946461446 learned_addr learned my addr 10.20.193.70:0/3946461446 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27a53a6c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc27410aa90 0x7fc2740fba50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc279d396c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc27410bb50 0x7fc2740fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27ad3b6c0 1 -- 10.20.193.70:0/3946461446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc27410bb50 msgr2=0x7fc2740fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27ad3b6c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc27410bb50 0x7fc2740fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27ad3b6c0 1 -- 10.20.193.70:0/3946461446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc27410aa90 msgr2=0x7fc2740fba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27ad3b6c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc27410aa90 0x7fc2740fba50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27ad3b6c0 1 -- 10.20.193.70:0/3946461446 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27000a660 con 0x7fc27410c500 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27ad3b6c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410c500 0x7fc2740fcc40 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc268005dc0 tx=0x7fc26800bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc25b7fe6c0 1 -- 10.20.193.70:0/3946461446 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc268004250 con 0x7fc27410c500 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc25b7fe6c0 1 -- 10.20.193.70:0/3946461446 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc268009070 con 0x7fc27410c500 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc25b7fe6c0 1 -- 10.20.193.70:0/3946461446 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc26800cd00 con 0x7fc27410c500 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27a53a6c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc27410aa90 0x7fc2740fba50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2740fd9b0 con 0x7fc27410c500 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.062+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2740563e0 con 0x7fc27410c500 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.063+0000 7fc25b7fe6c0 1 -- 10.20.193.70:0/3946461446 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fc2680071c0 con 0x7fc27410c500 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.063+0000 7fc25b7fe6c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc25003f8f0 0x7fc25005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.063+0000 7fc25b7fe6c0 1 -- 10.20.193.70:0/3946461446 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fc268051230 con 0x7fc27410c500 2026-02-13T03:43:32.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.064+0000 7fc27a53a6c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc25003f8f0 0x7fc25005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.065+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc274110e70 con 0x7fc27410c500 2026-02-13T03:43:32.069 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.067+0000 7fc27a53a6c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc25003f8f0 0x7fc25005fda0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc264004750 tx=0x7fc264005f30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.069 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.068+0000 7fc25b7fe6c0 1 -- 10.20.193.70:0/3946461446 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc2680143f0 con 0x7fc27410c500 2026-02-13T03:43:32.071 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:32.075 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.078+0000 7f940498c6c0 1 -- 10.20.193.70:0/1055847468 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10de30 msgr2=0x7f93fc10e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.078+0000 7f940498c6c0 1 --2- 10.20.193.70:0/1055847468 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10de30 0x7f93fc10e2a0 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=10320170503161463462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93e8009970 tx=0x7f93e802ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:32.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.078+0000 7f940498c6c0 1 -- 10.20.193.70:0/1055847468 shutdown_connections 2026-02-13T03:43:32.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.078+0000 7f940498c6c0 1 --2- 10.20.193.70:0/1055847468 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93fc10e7e0 0x7f93fc16f170 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.078+0000 7f940498c6c0 1 --2- 10.20.193.70:0/1055847468 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10de30 0x7f93fc10e2a0 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=10320170503161463462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.078+0000 7f940498c6c0 1 --2- 10.20.193.70:0/1055847468 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 0x7f93fc10d0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.079+0000 7f940498c6c0 1 -- 10.20.193.70:0/1055847468 >> 10.20.193.70:0/1055847468 conn(0x7f93fc0ea3d0 msgr2=0x7f93fc10a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.079+0000 7f940498c6c0 1 -- 10.20.193.70:0/1055847468 shutdown_connections 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.079+0000 7f940498c6c0 1 -- 10.20.193.70:0/1055847468 wait complete. 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f940498c6c0 1 Processor -- start 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f940498c6c0 1 -- start start 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f940498c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 0x7f93fc0f8fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f940498c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93fc10de30 0x7f93fc16f150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f940498c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10e7e0 0x7f93fc0f9810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f940498c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0fa460 con 0x7f93fc10e7e0 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f940498c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0fa5d0 con 0x7f93fc10de30 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f940498c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0fa790 con 0x7f93fc10ccb0 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9402efe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10e7e0 0x7f93fc0f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9402efe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10e7e0 0x7f93fc0f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43864/0 (socket says 10.20.193.70:43864) 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f94026fd6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 0x7f93fc0f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9402efe6c0 1 -- 10.20.193.70:0/3202638389 learned_addr learned my addr 10.20.193.70:0/3202638389 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f94026fd6c0 1 -- 10.20.193.70:0/3202638389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 msgr2=0x7f93fc0f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f94026fd6c0 1 -- 10.20.193.70:0/3202638389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 msgr2=0x7f93fc0f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f94026fd6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 0x7f93fc0f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f94026fd6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 0x7f93fc0f8fd0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9402efe6c0 1 -- 10.20.193.70:0/3202638389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 msgr2=0x7f93fc0f8fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9402efe6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 0x7f93fc0f8fd0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9402efe6c0 1 -- 10.20.193.70:0/3202638389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93fc10de30 msgr2=0x7f93fc16f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9401efc6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93fc10de30 0x7f93fc16f150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9402efe6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93fc10de30 0x7f93fc16f150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9402efe6c0 1 -- 10.20.193.70:0/3202638389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e8009590 con 0x7f93fc10e7e0 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9401efc6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93fc10de30 0x7f93fc16f150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f9402efe6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10e7e0 0x7f93fc0f9810 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93f0006ea0 tx=0x7f93f0006530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.080+0000 7f93e77fe6c0 1 -- 10.20.193.70:0/3202638389 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93f0003c40 con 0x7f93fc10e7e0 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.081+0000 7f93e77fe6c0 1 -- 10.20.193.70:0/3202638389 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f93f0006790 con 0x7f93fc10e7e0 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.081+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc0faa10 con 0x7f93fc10e7e0 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.081+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc0fae90 con 0x7f93fc10e7e0 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.081+0000 7f93e77fe6c0 1 -- 10.20.193.70:0/3202638389 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93f0012070 con 0x7f93fc10e7e0 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.082+0000 7f93e77fe6c0 1 -- 10.20.193.70:0/3202638389 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f93f0012200 con 0x7f93fc10e7e0 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.082+0000 7f93e77fe6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f93d803f8f0 0x7f93d805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.082+0000 7f93e77fe6c0 1 -- 10.20.193.70:0/3202638389 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f93f0010040 con 0x7f93fc10e7e0 2026-02-13T03:43:32.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.082+0000 7f94026fd6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f93d803f8f0 0x7f93d805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.082+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93fc173110 con 0x7f93fc10e7e0 2026-02-13T03:43:32.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.083+0000 7f94026fd6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f93d803f8f0 0x7f93d805fda0 secure :-1 s=READY pgs=61 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93f4005980 tx=0x7f93f4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.089 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:32.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.087+0000 7f93e77fe6c0 1 -- 10.20.193.70:0/3202638389 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f93f0014590 con 0x7f93fc10e7e0 2026-02-13T03:43:32.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.098+0000 7f3b641146c0 1 -- 10.20.193.70:0/3661388238 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10e780 msgr2=0x7f3b5c16f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.098+0000 7f3b641146c0 1 --2- 10.20.193.70:0/3661388238 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10e780 0x7f3b5c16f110 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=2373907571141882378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b500098a0 tx=0x7f3b5002ec40 comp rx=0 tx=0).stop 2026-02-13T03:43:32.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.098+0000 7f3b641146c0 1 -- 10.20.193.70:0/3661388238 shutdown_connections 2026-02-13T03:43:32.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.098+0000 7f3b641146c0 1 --2- 10.20.193.70:0/3661388238 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10e780 0x7f3b5c16f110 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=2373907571141882378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.098+0000 7f3b641146c0 1 --2- 10.20.193.70:0/3661388238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b5c10ddd0 0x7f3b5c10e240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.098+0000 7f3b641146c0 1 --2- 10.20.193.70:0/3661388238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b5c10cc50 0x7f3b5c10d040 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.098+0000 7f3b641146c0 1 -- 10.20.193.70:0/3661388238 >> 10.20.193.70:0/3661388238 conn(0x7f3b5c0ea370 msgr2=0x7f3b5c10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.098+0000 7f3b641146c0 1 -- 10.20.193.70:0/3661388238 shutdown_connections 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.098+0000 7f3b641146c0 1 -- 10.20.193.70:0/3661388238 wait complete. 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b641146c0 1 Processor -- start 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b641146c0 1 -- start start 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b641146c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10cc50 0x7f3b5c0f85a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b641146c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b5c10ddd0 0x7f3b5c16f0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b641146c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b5c10e780 0x7f3b5c0f8de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b61e856c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10cc50 0x7f3b5c0f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b61e856c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10cc50 0x7f3b5c0f85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43880/0 (socket says 10.20.193.70:43880) 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b61e856c0 1 -- 10.20.193.70:0/4269796726 learned_addr learned my addr 10.20.193.70:0/4269796726 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b626866c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b5c10e780 0x7f3b5c0f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0f9a30 con 0x7f3b5c10cc50 2026-02-13T03:43:32.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0f9ba0 con 0x7f3b5c10ddd0 2026-02-13T03:43:32.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.099+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0f9d60 con 0x7f3b5c10e780 2026-02-13T03:43:32.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b616846c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b5c10ddd0 0x7f3b5c16f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b61e856c0 1 -- 10.20.193.70:0/4269796726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b5c10e780 msgr2=0x7f3b5c0f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b61e856c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b5c10e780 0x7f3b5c0f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b61e856c0 1 -- 10.20.193.70:0/4269796726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b5c10ddd0 msgr2=0x7f3b5c16f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b61e856c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b5c10ddd0 0x7f3b5c16f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b61e856c0 1 -- 10.20.193.70:0/4269796726 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b500094c0 con 0x7f3b5c10cc50 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b61e856c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10cc50 0x7f3b5c0f85a0 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b5800a970 tx=0x7f3b5800ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b4affd6c0 1 -- 10.20.193.70:0/4269796726 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b5800e9e0 con 0x7f3b5c10cc50 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b4affd6c0 1 -- 10.20.193.70:0/4269796726 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3b5800a030 con 0x7f3b5c10cc50 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b4affd6c0 1 -- 10.20.193.70:0/4269796726 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b58012070 con 0x7f3b5c10cc50 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.100+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c0f9fe0 con 0x7f3b5c10cc50 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.101+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c0fa3e0 con 0x7f3b5c10cc50 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.101+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c172ff0 con 0x7f3b5c10cc50 2026-02-13T03:43:32.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.101+0000 7f3b4affd6c0 1 -- 10.20.193.70:0/4269796726 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f3b580081c0 con 0x7f3b5c10cc50 2026-02-13T03:43:32.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.102+0000 7f3b4affd6c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3b3803f940 0x7f3b3805fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.102+0000 7f3b616846c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3b3803f940 0x7f3b3805fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.102+0000 7f3b4affd6c0 1 -- 10.20.193.70:0/4269796726 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f3b58052430 con 0x7f3b5c10cc50 2026-02-13T03:43:32.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.102+0000 7f3b616846c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3b3803f940 0x7f3b3805fdf0 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b4c005fd0 tx=0x7f3b4c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.105+0000 7f3b4affd6c0 1 -- 10.20.193.70:0/4269796726 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3b580106b0 con 0x7f3b5c10cc50 2026-02-13T03:43:32.108 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.127 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:32.131 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.130+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f874410bee0 con 0x7f874410cc70 2026-02-13T03:43:32.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.131+0000 7fc543fff6c0 1 -- 10.20.193.70:0/2039414024 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fc538005b40 con 0x7fc574114120 2026-02-13T03:43:32.137 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.136+0000 7f8740ff96c0 1 -- 10.20.193.70:0/1644767183 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v19)=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f87300317a0 con 0x7f874410cc70 2026-02-13T03:43:32.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/1751491154 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5e7810cd80 msgr2=0x7f5e7816d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/1751491154 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5e7810cd80 0x7f5e7816d710 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=852405572436130253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7400bb90 tx=0x7f5e7402fde0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/1751491154 shutdown_connections 2026-02-13T03:43:32.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/1751491154 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5e7810cd80 0x7f5e7816d710 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=852405572436130253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.143 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/1751491154 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e7810c3d0 0x7f5e7810c840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.143 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/1751491154 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810b250 0x7f5e7810b640 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.143 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/1751491154 >> 10.20.193.70:0/1751491154 conn(0x7f5e780e8970 msgr2=0x7f5e78108d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.143 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/1751491154 shutdown_connections 2026-02-13T03:43:32.143 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.141+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/1751491154 wait complete. 2026-02-13T03:43:32.143 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.141+0000 7f5e7ff546c0 1 Processor -- start 2026-02-13T03:43:32.144 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.141+0000 7f5e7ff546c0 1 -- start start 2026-02-13T03:43:32.144 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7ff546c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e7810b250 0x7f5e780f2ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.144 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7ff546c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5e7810c3d0 0x7f5e7816d6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.144 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7ff546c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 0x7f5e780f3310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.144 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.141+0000 7fbe660a16c0 1 -- 10.20.193.70:0/1954001170 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe6010eec0 msgr2=0x7fbe6010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.144 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.141+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/1954001170 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe6010eec0 0x7fbe6010f2b0 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=12698745239185620088 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4c0098a0 tx=0x7fbe4c02ec40 comp rx=0 tx=0).stop 2026-02-13T03:43:32.145 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7ff546c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5e780f3f60 con 0x7f5e7810c3d0 2026-02-13T03:43:32.145 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7ff546c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5e780f40d0 con 0x7f5e7810cd80 2026-02-13T03:43:32.145 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7ff546c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e780f4290 con 0x7f5e7810b250 2026-02-13T03:43:32.145 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7fbe660a16c0 1 -- 10.20.193.70:0/1954001170 shutdown_connections 2026-02-13T03:43:32.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/1954001170 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe601109f0 0x7fbe60171380 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/1954001170 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe60110040 0x7fbe601104b0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/1954001170 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe6010eec0 0x7fbe6010f2b0 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=12698745239185620088 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7fbe660a16c0 1 -- 10.20.193.70:0/1954001170 >> 10.20.193.70:0/1954001170 conn(0x7fbe600ec5c0 msgr2=0x7fbe6010c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7fbe660a16c0 1 -- 10.20.193.70:0/1954001170 shutdown_connections 2026-02-13T03:43:32.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7fbe660a16c0 1 -- 10.20.193.70:0/1954001170 wait complete. 2026-02-13T03:43:32.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7e4c66c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 0x7f5e780f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7e4c66c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 0x7f5e780f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:33744/0 (socket says 10.20.193.70:33744) 2026-02-13T03:43:32.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7e4c66c0 1 -- 10.20.193.70:0/3163468032 learned_addr learned my addr 10.20.193.70:0/3163468032 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7e4c66c0 1 -- 10.20.193.70:0/3163468032 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 msgr2=0x7f5e780f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:43:32.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7e4c66c0 1 -- 10.20.193.70:0/3163468032 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 msgr2=0x7f5e780f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:32.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7e4c66c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 0x7f5e780f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:32.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7e4c66c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 0x7f5e780f3310 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:32.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7f5e7d4c46c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5e7810c3d0 0x7f5e7816d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.148 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.141+0000 7ff33d1236c0 1 -- 10.20.193.70:0/487520730 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff33810eed0 msgr2=0x7ff33810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.148 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.141+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/487520730 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff33810eed0 0x7ff33810f2c0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=7321527426905270077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff32c0098a0 tx=0x7ff32c02ec40 comp rx=0 tx=0).stop 2026-02-13T03:43:32.148 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7ff33d1236c0 1 -- 10.20.193.70:0/487520730 shutdown_connections 2026-02-13T03:43:32.148 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/487520730 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff338110a00 0x7ff338171390 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.148 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/487520730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338110050 0x7ff3381104c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.148 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/487520730 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff33810eed0 0x7ff33810f2c0 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=7321527426905270077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.148 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7ff33d1236c0 1 -- 10.20.193.70:0/487520730 >> 10.20.193.70:0/487520730 conn(0x7ff3380ec5f0 msgr2=0x7ff33810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.148 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7ff33d1236c0 1 -- 10.20.193.70:0/487520730 shutdown_connections 2026-02-13T03:43:32.149 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.142+0000 7ff33d1236c0 1 -- 10.20.193.70:0/487520730 wait complete. 2026-02-13T03:43:32.149 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e7d4c46c0 1 -- 10.20.193.70:0/3163468032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e7810b250 msgr2=0x7f5e780f2ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:43:32.149 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e7d4c46c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e7810b250 0x7f5e780f2ad0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.149 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e7d4c46c0 1 -- 10.20.193.70:0/3163468032 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 msgr2=0x7f5e780f3310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:32.149 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe660a16c0 1 Processor -- start 2026-02-13T03:43:32.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e7d4c46c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 0x7f5e780f3310 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e7d4c46c0 1 -- 10.20.193.70:0/3163468032 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7400b7b0 con 0x7f5e7810c3d0 2026-02-13T03:43:32.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe660a16c0 1 -- start start 2026-02-13T03:43:32.151 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e7d4c46c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5e7810c3d0 0x7f5e7816d6f0 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e6c00c6b0 tx=0x7f5e6c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.151 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e66ffd6c0 1 -- 10.20.193.70:0/3163468032 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e6c004290 con 0x7f5e7810c3d0 2026-02-13T03:43:32.151 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e66ffd6c0 1 -- 10.20.193.70:0/3163468032 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5e6c009030 con 0x7f5e7810c3d0 2026-02-13T03:43:32.151 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e66ffd6c0 1 -- 10.20.193.70:0/3163468032 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e6c00afd0 con 0x7f5e7810c3d0 2026-02-13T03:43:32.151 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e780f4510 con 0x7f5e7810c3d0 2026-02-13T03:43:32.151 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e780f49a0 con 0x7f5e7810c3d0 2026-02-13T03:43:32.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe660a16c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe6010eec0 0x7fbe600f85b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f871003f870 msgr2=0x7f871005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f871003f870 0x7f871005fd20 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8734007240 tx=0x7f8734007640 comp rx=0 tx=0).stop 2026-02-13T03:43:32.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f874410cc70 msgr2=0x7f874411c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f874410cc70 0x7f874411c9d0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f873002f150 tx=0x7f8730004530 comp rx=0 tx=0).stop 2026-02-13T03:43:32.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe660a16c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe60110040 0x7fbe60171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe660a16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe601109f0 0x7fbe600f8e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe660a16c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe600f9a40 con 0x7fbe601109f0 2026-02-13T03:43:32.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe660a16c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbe600f9bb0 con 0x7fbe60110040 2026-02-13T03:43:32.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe660a16c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe600f9d70 con 0x7fbe6010eec0 2026-02-13T03:43:32.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe5effd6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe60110040 0x7fbe60171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.154 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe5effd6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe60110040 0x7fbe60171380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:33748/0 (socket says 10.20.193.70:33748) 2026-02-13T03:43:32.154 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe5effd6c0 1 -- 10.20.193.70:0/153048310 learned_addr learned my addr 10.20.193.70:0/153048310 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.154 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7fbe5ffff6c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe601109f0 0x7fbe600f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.154 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff33d1236c0 1 Processor -- start 2026-02-13T03:43:32.154 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff33d1236c0 1 -- start start 2026-02-13T03:43:32.154 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff33d1236c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff33810eed0 0x7ff33811a560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e78170430 con 0x7f5e7810c3d0 2026-02-13T03:43:32.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff33d1236c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338110050 0x7ff33811abb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff33d1236c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff338110a00 0x7ff33811b7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff33d1236c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff33811bf00 con 0x7ff338110a00 2026-02-13T03:43:32.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff33d1236c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff33811c070 con 0x7ff33810eed0 2026-02-13T03:43:32.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff33d1236c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff33811c230 con 0x7ff338110050 2026-02-13T03:43:32.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3375776c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff338110a00 0x7ff33811b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3375776c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff338110a00 0x7ff33811b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43912/0 (socket says 10.20.193.70:43912) 2026-02-13T03:43:32.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3375776c0 1 -- 10.20.193.70:0/1577919167 learned_addr learned my addr 10.20.193.70:0/1577919167 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3365756c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338110050 0x7ff33811abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe5ffff6c0 1 -- 10.20.193.70:0/153048310 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe6010eec0 msgr2=0x7fbe600f85b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:43:32.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe5ffff6c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe6010eec0 0x7fbe600f85b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe5ffff6c0 1 -- 10.20.193.70:0/153048310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe60110040 msgr2=0x7fbe60171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.157 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe5ffff6c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe60110040 0x7fbe60171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.157 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3375776c0 1 -- 10.20.193.70:0/1577919167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338110050 msgr2=0x7ff33811abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.157 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe5ffff6c0 1 -- 10.20.193.70:0/153048310 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c0094c0 con 0x7fbe601109f0 2026-02-13T03:43:32.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3375776c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338110050 0x7ff33811abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3375776c0 1 -- 10.20.193.70:0/1577919167 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff33810eed0 msgr2=0x7ff33811a560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:43:32.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3375776c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff33810eed0 0x7ff33811a560 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3375776c0 1 -- 10.20.193.70:0/1577919167 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c0094c0 con 0x7ff338110a00 2026-02-13T03:43:32.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe5ffff6c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe601109f0 0x7fbe600f8e10 secure :-1 s=READY pgs=122 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe54006f60 tx=0x7fbe5400ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3365756c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338110050 0x7ff33811abb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:43:32.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff3375776c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff338110a00 0x7ff33811b7a0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff328006ea0 tx=0x7ff3280068a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.143+0000 7ff317fff6c0 1 -- 10.20.193.70:0/1577919167 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff328003a30 con 0x7ff338110a00 2026-02-13T03:43:32.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7ff317fff6c0 1 -- 10.20.193.70:0/1577919167 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff3280054f0 con 0x7ff338110a00 2026-02-13T03:43:32.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe5cff96c0 1 -- 10.20.193.70:0/153048310 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe54005b60 con 0x7fbe601109f0 2026-02-13T03:43:32.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe5cff96c0 1 -- 10.20.193.70:0/153048310 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbe5400a030 con 0x7fbe601109f0 2026-02-13T03:43:32.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7ff317fff6c0 1 -- 10.20.193.70:0/1577919167 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff328012070 con 0x7ff338110a00 2026-02-13T03:43:32.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe5cff96c0 1 -- 10.20.193.70:0/153048310 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe5400ecb0 con 0x7fbe601109f0 2026-02-13T03:43:32.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33811c510 con 0x7ff338110a00 2026-02-13T03:43:32.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe600fa050 con 0x7fbe601109f0 2026-02-13T03:43:32.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33816de50 con 0x7ff338110a00 2026-02-13T03:43:32.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.140+0000 7fc5627fc6c0 1 -- 10.20.193.70:0/2039414024 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v20)=0 v20) ==== 116+0+0 (secure 0 0 0) 0x7fc568004b10 con 0x7fc574114120 2026-02-13T03:43:32.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fc543fff6c0 1 -- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc55003f8f0 msgr2=0x7fc55005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.144+0000 7fc543fff6c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc55003f8f0 0x7fc55005fda0 secure :-1 s=READY pgs=57 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc564005b40 tx=0x7fc564005de0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.145+0000 7fc543fff6c0 1 -- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc574114120 msgr2=0x7fc5741757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.145+0000 7fc543fff6c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc574114120 0x7fc5741757c0 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc56800b6c0 tx=0x7fc56800bb90 comp rx=0 tx=0).stop 2026-02-13T03:43:32.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.145+0000 7f5e66ffd6c0 1 -- 10.20.193.70:0/3163468032 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f5e6c0043f0 con 0x7f5e7810c3d0 2026-02-13T03:43:32.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.145+0000 7f5e66ffd6c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e5403f8f0 0x7f5e5405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/3413096839 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410ddd0 msgr2=0x7f4d2410e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/3413096839 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410ddd0 0x7f4d2410e240 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=8878013623195341897 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d1800ddb0 tx=0x7f4d18033170 comp rx=0 tx=0).stop 2026-02-13T03:43:32.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.145+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff338063e90 con 0x7ff338110a00 2026-02-13T03:43:32.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.145+0000 7ff317fff6c0 1 -- 10.20.193.70:0/1577919167 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7ff328003b90 con 0x7ff338110a00 2026-02-13T03:43:32.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7ff317fff6c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff30c03f870 0x7ff30c05fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7ff317fff6c0 1 -- 10.20.193.70:0/1577919167 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7ff328052300 con 0x7ff338110a00 2026-02-13T03:43:32.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/3413096839 shutdown_connections 2026-02-13T03:43:32.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/3413096839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4d2410e780 0x7f4d2416f110 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/3413096839 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410ddd0 0x7f4d2410e240 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=8878013623195341897 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/3413096839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410cc50 0x7f4d2410d040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/3413096839 >> 10.20.193.70:0/3413096839 conn(0x7f4d240ea370 msgr2=0x7f4d2410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/3413096839 shutdown_connections 2026-02-13T03:43:32.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/3413096839 wait complete. 2026-02-13T03:43:32.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7ff336d766c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff30c03f870 0x7ff30c05fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.145+0000 7f5e66ffd6c0 1 -- 10.20.193.70:0/3163468032 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f5e6c051180 con 0x7f5e7810c3d0 2026-02-13T03:43:32.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f5e7dcc56c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e5403f8f0 0x7f5e5405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f5e7dcc56c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e5403f8f0 0x7f5e5405fda0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e68004750 tx=0x7f5e680093b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7ff336d766c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff30c03f870 0x7ff30c05fd20 secure :-1 s=READY pgs=64 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff32c02f150 tx=0x7ff32c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7f4d2bfdb6c0 1 Processor -- start 2026-02-13T03:43:32.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7fc543fff6c0 1 -- 10.20.193.70:0/2039414024 shutdown_connections 2026-02-13T03:43:32.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7fc543fff6c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc55003f8f0 0x7fc55005fda0 unknown :-1 s=CLOSED pgs=57 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7fc543fff6c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc574114cb0 0x7fc5740ff090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7fc543fff6c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc574114120 0x7fc5741757c0 unknown :-1 s=CLOSED pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7fc543fff6c0 1 --2- 10.20.193.70:0/2039414024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5741137a0 0x7fc5740fe830 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.146+0000 7fc543fff6c0 1 -- 10.20.193.70:0/2039414024 >> 10.20.193.70:0/2039414024 conn(0x7fc574064120 msgr2=0x7fc5740f4920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2bfdb6c0 1 -- start start 2026-02-13T03:43:32.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2bfdb6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410cc50 0x7f4d24113640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2bfdb6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4d2410ddd0 0x7f4d24113c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2bfdb6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410e780 0x7f4d24114880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2bfdb6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4d24115010 con 0x7f4d2410cc50 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2bfdb6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4d24115180 con 0x7f4d2410ddd0 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2bfdb6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d24115340 con 0x7f4d2410e780 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d29d4c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410cc50 0x7f4d24113640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d29d4c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410cc50 0x7f4d24113640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43942/0 (socket says 10.20.193.70:43942) 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d29d4c6c0 1 -- 10.20.193.70:0/1724790916 learned_addr learned my addr 10.20.193.70:0/1724790916 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2954b6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4d2410ddd0 0x7f4d24113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2a54d6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410e780 0x7f4d24114880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2a54d6c0 1 -- 10.20.193.70:0/1724790916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410e780 msgr2=0x7f4d24114880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2a54d6c0 1 -- 10.20.193.70:0/1724790916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410e780 msgr2=0x7f4d24114880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2a54d6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410e780 0x7f4d24114880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d29d4c6c0 1 -- 10.20.193.70:0/1724790916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410e780 msgr2=0x7f4d24114880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.169 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d2a54d6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410e780 0x7f4d24114880 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:32.170 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d29d4c6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410e780 0x7f4d24114880 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.170 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d29d4c6c0 1 -- 10.20.193.70:0/1724790916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4d2410ddd0 msgr2=0x7f4d24113c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.170 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d29d4c6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4d2410ddd0 0x7f4d24113c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.170 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d29d4c6c0 1 -- 10.20.193.70:0/1724790916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1800d9d0 con 0x7f4d2410cc50 2026-02-13T03:43:32.170 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7f4d29d4c6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410cc50 0x7f4d24113640 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d14005980 tx=0x7f4d1400bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.170 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7fbe5cff96c0 1 -- 10.20.193.70:0/153048310 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fbe54005cc0 con 0x7fbe601109f0 2026-02-13T03:43:32.170 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe600fa480 con 0x7fbe601109f0 2026-02-13T03:43:32.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7fc543fff6c0 1 -- 10.20.193.70:0/2039414024 shutdown_connections 2026-02-13T03:43:32.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.147+0000 7fc543fff6c0 1 -- 10.20.193.70:0/2039414024 wait complete. 2026-02-13T03:43:32.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 shutdown_connections 2026-02-13T03:43:32.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f871003f870 0x7f871005fd20 unknown :-1 s=CLOSED pgs=58 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f874410d620 0x7f874411d5c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f874410cc70 0x7f874411c9d0 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7f8749c6c6c0 1 --2- 10.20.193.70:0/1644767183 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f874410baf0 0x7f874411c380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 >> 10.20.193.70:0/1644767183 conn(0x7f87440e91f0 msgr2=0x7f87441095d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.172 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7fbe5cff96c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbe3403f8f0 0x7fbe3405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.172 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 shutdown_connections 2026-02-13T03:43:32.172 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7f8749c6c6c0 1 -- 10.20.193.70:0/1644767183 wait complete. 2026-02-13T03:43:32.172 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe60175320 con 0x7fbe601109f0 2026-02-13T03:43:32.172 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7fbe5f7fe6c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbe3403f8f0 0x7fbe3405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.148+0000 7f5e66ffd6c0 1 -- 10.20.193.70:0/3163468032 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5e6c0071c0 con 0x7f5e7810c3d0 2026-02-13T03:43:32.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.149+0000 7fbe5f7fe6c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbe3403f8f0 0x7fbe3405fda0 secure :-1 s=READY pgs=65 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4c02f150 tx=0x7fbe4c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.150+0000 7fbe5cff96c0 1 -- 10.20.193.70:0/153048310 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fbe54009030 con 0x7fbe601109f0 2026-02-13T03:43:32.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.150+0000 7ff317fff6c0 1 -- 10.20.193.70:0/1577919167 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff32800e040 con 0x7ff338110a00 2026-02-13T03:43:32.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.150+0000 7f4d12ffd6c0 1 -- 10.20.193.70:0/1724790916 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d14004250 con 0x7f4d2410cc50 2026-02-13T03:43:32.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.150+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d24115620 con 0x7f4d2410cc50 2026-02-13T03:43:32.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.150+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d24155c50 con 0x7f4d2410cc50 2026-02-13T03:43:32.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.151+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d24170b40 con 0x7f4d2410cc50 2026-02-13T03:43:32.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.152+0000 7f4d12ffd6c0 1 -- 10.20.193.70:0/1724790916 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4d1400be30 con 0x7f4d2410cc50 2026-02-13T03:43:32.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.152+0000 7f4d12ffd6c0 1 -- 10.20.193.70:0/1724790916 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d14005300 con 0x7f4d2410cc50 2026-02-13T03:43:32.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.153+0000 7f4d12ffd6c0 1 -- 10.20.193.70:0/1724790916 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f4d14005490 con 0x7f4d2410cc50 2026-02-13T03:43:32.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.153+0000 7f4d12ffd6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4d0003f8f0 0x7f4d0005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.153+0000 7f4d12ffd6c0 1 -- 10.20.193.70:0/1724790916 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f4d14051350 con 0x7f4d2410cc50 2026-02-13T03:43:32.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.153+0000 7fbe5cff96c0 1 -- 10.20.193.70:0/153048310 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbe54008580 con 0x7fbe601109f0 2026-02-13T03:43:32.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.153+0000 7f4d2954b6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4d0003f8f0 0x7f4d0005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.154+0000 7f4d2954b6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4d0003f8f0 0x7f4d0005fda0 secure :-1 s=READY pgs=66 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d1800b940 tx=0x7f4d180023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.155+0000 7f4d12ffd6c0 1 -- 10.20.193.70:0/1724790916 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d14005770 con 0x7f4d2410cc50 2026-02-13T03:43:32.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.162+0000 7f9afa7fc6c0 1 -- 10.20.193.70:0/3514082016 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f9ae8005b40 con 0x7f9b2010ddd0 2026-02-13T03:43:32.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.166+0000 7f9b1cff96c0 1 -- 10.20.193.70:0/3514082016 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f9b1000fe40 con 0x7f9b2010ddd0 2026-02-13T03:43:32.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 -- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9af403f8f0 msgr2=0x7f9af405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9af403f8f0 0x7f9af405fda0 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b0c02f230 tx=0x7f9b0c0023a0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 -- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010ddd0 msgr2=0x7f9b2016f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010ddd0 0x7f9b2016f110 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b1000b710 tx=0x7f9b1000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 -- 10.20.193.70:0/3514082016 shutdown_connections 2026-02-13T03:43:32.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9af403f8f0 0x7f9af405fda0 unknown :-1 s=CLOSED pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2010e780 0x7f9b20057ac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b2010ddd0 0x7f9b2016f110 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 --2- 10.20.193.70:0/3514082016 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b2010cc50 0x7f9b20057260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 -- 10.20.193.70:0/3514082016 >> 10.20.193.70:0/3514082016 conn(0x7f9b200ea370 msgr2=0x7f9b20173c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 -- 10.20.193.70:0/3514082016 shutdown_connections 2026-02-13T03:43:32.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.170+0000 7f9afa7fc6c0 1 -- 10.20.193.70:0/3514082016 wait complete. 2026-02-13T03:43:32.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.201+0000 7fd679db46c0 1 -- 10.20.193.70:0/1432134090 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 msgr2=0x7fd67410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.201+0000 7fd679db46c0 1 --2- 10.20.193.70:0/1432134090 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 0x7fd67410d040 secure :-1 s=READY pgs=125 gs=3 cs=0 l=1 c_cookie=7739191989694228097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd660009b00 tx=0x7fd66002eeb0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.201+0000 7fd679db46c0 1 -- 10.20.193.70:0/1432134090 shutdown_connections 2026-02-13T03:43:32.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.201+0000 7fd679db46c0 1 --2- 10.20.193.70:0/1432134090 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 0x7fd67416f110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.201+0000 7fd679db46c0 1 --2- 10.20.193.70:0/1432134090 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd67410ddd0 0x7fd67410e240 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.201+0000 7fd679db46c0 1 --2- 10.20.193.70:0/1432134090 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 0x7fd67410d040 unknown :-1 s=CLOSED pgs=125 gs=3 cs=0 l=1 c_cookie=7739191989694228097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.201+0000 7fd679db46c0 1 -- 10.20.193.70:0/1432134090 >> 10.20.193.70:0/1432134090 conn(0x7fd6740ea370 msgr2=0x7fd67410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.201+0000 7fd679db46c0 1 -- 10.20.193.70:0/1432134090 shutdown_connections 2026-02-13T03:43:32.204 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.202+0000 7fd679db46c0 1 -- 10.20.193.70:0/1432134090 wait complete. 2026-02-13T03:43:32.204 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.202+0000 7fd679db46c0 1 Processor -- start 2026-02-13T03:43:32.204 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.202+0000 7fd679db46c0 1 -- start start 2026-02-13T03:43:32.204 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.202+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fc27410ae80 con 0x7fc27410c500 2026-02-13T03:43:32.205 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.202+0000 7fd679db46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 0x7fd6740f2d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.202+0000 7fd679db46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd67410ddd0 0x7fd67416f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.202+0000 7fd679db46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 0x7fd6740f3590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.202+0000 7fd6737fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 0x7fd6740f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd6737fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 0x7fd6740f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43962/0 (socket says 10.20.193.70:43962) 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd6737fe6c0 1 -- 10.20.193.70:0/4176614086 learned_addr learned my addr 10.20.193.70:0/4176614086 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740f41c0 con 0x7fd67410cc50 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740f4330 con 0x7fd67410e780 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740f44f0 con 0x7fd67410ddd0 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd673fff6c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 0x7fd6740f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd672ffd6c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd67410ddd0 0x7fd67416f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd673fff6c0 1 -- 10.20.193.70:0/4176614086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 msgr2=0x7fd6740f3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd673fff6c0 1 -- 10.20.193.70:0/4176614086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 msgr2=0x7fd6740f3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:32.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd673fff6c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 0x7fd6740f3590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:32.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd673fff6c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 0x7fd6740f3590 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:32.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd6737fe6c0 1 -- 10.20.193.70:0/4176614086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd67410ddd0 msgr2=0x7fd67416f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd6737fe6c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd67410ddd0 0x7fd67416f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd6737fe6c0 1 -- 10.20.193.70:0/4176614086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 msgr2=0x7fd6740f3590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:32.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd6737fe6c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 0x7fd6740f3590 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd6737fe6c0 1 -- 10.20.193.70:0/4176614086 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6600094c0 con 0x7fd67410cc50 2026-02-13T03:43:32.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.203+0000 7fd6737fe6c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 0x7fd6740f2d30 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd660004600 tx=0x7fd660031730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.205+0000 7fc25b7fe6c0 1 -- 10.20.193.70:0/3946461446 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fc268011030 con 0x7fc27410c500 2026-02-13T03:43:32.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.206+0000 7fd670ff96c0 1 -- 10.20.193.70:0/4176614086 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd660031dc0 con 0x7fd67410cc50 2026-02-13T03:43:32.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.206+0000 7fd670ff96c0 1 -- 10.20.193.70:0/4176614086 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd660007680 con 0x7fd67410cc50 2026-02-13T03:43:32.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.206+0000 7fd670ff96c0 1 -- 10.20.193.70:0/4176614086 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd660037520 con 0x7fd67410cc50 2026-02-13T03:43:32.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.206+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6740f4770 con 0x7fd67410cc50 2026-02-13T03:43:32.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.206+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6740f4ae0 con 0x7fd67410cc50 2026-02-13T03:43:32.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7fd670ff96c0 1 -- 10.20.193.70:0/4176614086 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fd660031070 con 0x7fd67410cc50 2026-02-13T03:43:32.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6741730b0 con 0x7fd67410cc50 2026-02-13T03:43:32.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7fd670ff96c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd64803f940 0x7fd64805fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7fd672ffd6c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd64803f940 0x7fd64805fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7f65776e06c0 1 -- 10.20.193.70:0/2110423239 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 msgr2=0x7f657010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7f65776e06c0 1 --2- 10.20.193.70:0/2110423239 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 0x7f657010f2c0 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=4561483022006913353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6560009970 tx=0x7f656002ed70 comp rx=0 tx=0).stop 2026-02-13T03:43:32.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7fd670ff96c0 1 -- 10.20.193.70:0/4176614086 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fd660076710 con 0x7fd67410cc50 2026-02-13T03:43:32.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7f65776e06c0 1 -- 10.20.193.70:0/2110423239 shutdown_connections 2026-02-13T03:43:32.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7f65776e06c0 1 --2- 10.20.193.70:0/2110423239 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6570110a00 0x7f6570171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7f65776e06c0 1 --2- 10.20.193.70:0/2110423239 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6570110050 0x7f65701104c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7f65776e06c0 1 --2- 10.20.193.70:0/2110423239 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 0x7f657010f2c0 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=4561483022006913353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.207+0000 7f65776e06c0 1 -- 10.20.193.70:0/2110423239 >> 10.20.193.70:0/2110423239 conn(0x7f65700ec5f0 msgr2=0x7f657010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 -- 10.20.193.70:0/2110423239 shutdown_connections 2026-02-13T03:43:32.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 -- 10.20.193.70:0/2110423239 wait complete. 2026-02-13T03:43:32.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fd672ffd6c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd64803f940 0x7fd64805fdf0 secure :-1 s=READY pgs=67 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd664005980 tx=0x7fd664005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc25003f8f0 msgr2=0x7fc25005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc25003f8f0 0x7fc25005fda0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc264004750 tx=0x7fc264005f30 comp rx=0 tx=0).stop 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410c500 msgr2=0x7fc2740fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410c500 0x7fc2740fcc40 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc268005dc0 tx=0x7fc26800bb60 comp rx=0 tx=0).stop 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 shutdown_connections 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc25003f8f0 0x7fc25005fda0 unknown :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc27410c500 0x7fc2740fcc40 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc27410bb50 0x7fc2740fc0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 --2- 10.20.193.70:0/3946461446 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc27410aa90 0x7fc2740fba50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 >> 10.20.193.70:0/3946461446 conn(0x7fc2740e8510 msgr2=0x7fc274109900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 shutdown_connections 2026-02-13T03:43:32.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7fc27c7c96c0 1 -- 10.20.193.70:0/3946461446 wait complete. 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 Processor -- start 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 -- start start 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 0x7f65700f86a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6570110050 0x7f6570171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6570110a00 0x7f65700f8f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65700f9b30 con 0x7f657010eed0 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f65700f9ca0 con 0x7f6570110a00 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65776e06c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f65700f9e60 con 0x7f6570110050 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65754516c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 0x7f65700f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65754516c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 0x7f65700f86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43972/0 (socket says 10.20.193.70:43972) 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65754516c0 1 -- 10.20.193.70:0/4211795200 learned_addr learned my addr 10.20.193.70:0/4211795200 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65754516c0 1 -- 10.20.193.70:0/4211795200 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6570110050 msgr2=0x7f6570171390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:43:32.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65754516c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6570110050 0x7f6570171390 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65754516c0 1 -- 10.20.193.70:0/4211795200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6570110a00 msgr2=0x7f65700f8f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:43:32.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65754516c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6570110a00 0x7f65700f8f00 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65754516c0 1 -- 10.20.193.70:0/4211795200 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6560009590 con 0x7f657010eed0 2026-02-13T03:43:32.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.208+0000 7f65754516c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 0x7f65700f86a0 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65600092b0 tx=0x7f65600047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.210+0000 7f655e7fc6c0 1 -- 10.20.193.70:0/4211795200 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6560002be0 con 0x7f657010eed0 2026-02-13T03:43:32.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.210+0000 7f655e7fc6c0 1 -- 10.20.193.70:0/4211795200 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6560002d40 con 0x7f657010eed0 2026-02-13T03:43:32.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.210+0000 7f655e7fc6c0 1 -- 10.20.193.70:0/4211795200 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6560037360 con 0x7f657010eed0 2026-02-13T03:43:32.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.210+0000 7fd670ff96c0 1 -- 10.20.193.70:0/4176614086 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd6600376f0 con 0x7fd67410cc50 2026-02-13T03:43:32.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.210+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65700fa0e0 con 0x7f657010eed0 2026-02-13T03:43:32.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.210+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65700fa4e0 con 0x7f657010eed0 2026-02-13T03:43:32.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.211+0000 7f655e7fc6c0 1 -- 10.20.193.70:0/4211795200 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f65600071c0 con 0x7f657010eed0 2026-02-13T03:43:32.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.211+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65701752f0 con 0x7f657010eed0 2026-02-13T03:43:32.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.211+0000 7f655e7fc6c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f654c03f8f0 0x7f654c05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.211+0000 7f655e7fc6c0 1 -- 10.20.193.70:0/4211795200 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f6560075650 con 0x7f657010eed0 2026-02-13T03:43:32.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.211+0000 7f6574c506c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f654c03f8f0 0x7f654c05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.216 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.212+0000 7f6574c506c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f654c03f8f0 0x7f654c05fda0 secure :-1 s=READY pgs=68 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6564004770 tx=0x7f6564006c90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.216 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.214+0000 7f655e7fc6c0 1 -- 10.20.193.70:0/4211795200 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6560034040 con 0x7f657010eed0 2026-02-13T03:43:32.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.215+0000 7f4c024076c0 1 -- 10.20.193.70:0/753089740 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4bfc10e780 msgr2=0x7f4bfc16f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.215+0000 7f4c024076c0 1 --2- 10.20.193.70:0/753089740 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4bfc10e780 0x7f4bfc16f110 secure :-1 s=READY pgs=129 gs=2 cs=0 l=1 c_cookie=11354296747891407146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bf0006fd0 tx=0x7f4bf002fd20 comp rx=0 tx=0).stop 2026-02-13T03:43:32.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.215+0000 7f4c024076c0 1 -- 10.20.193.70:0/753089740 shutdown_connections 2026-02-13T03:43:32.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.215+0000 7f4c024076c0 1 --2- 10.20.193.70:0/753089740 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4bfc10e780 0x7f4bfc16f110 unknown :-1 s=CLOSED pgs=129 gs=2 cs=0 l=1 c_cookie=11354296747891407146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.215+0000 7f4c024076c0 1 --2- 10.20.193.70:0/753089740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 0x7f4bfc10e240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.215+0000 7f4c024076c0 1 --2- 10.20.193.70:0/753089740 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10cc50 0x7f4bfc10d040 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.215+0000 7f4c024076c0 1 -- 10.20.193.70:0/753089740 >> 10.20.193.70:0/753089740 conn(0x7f4bfc0ea370 msgr2=0x7f4bfc10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.215+0000 7f4c024076c0 1 -- 10.20.193.70:0/753089740 shutdown_connections 2026-02-13T03:43:32.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.215+0000 7f4c024076c0 1 -- 10.20.193.70:0/753089740 wait complete. 2026-02-13T03:43:32.219 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4c024076c0 1 Processor -- start 2026-02-13T03:43:32.219 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4c024076c0 1 -- start start 2026-02-13T03:43:32.219 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4c024076c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4bfc10cc50 0x7f4bfc0f83e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.219 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4c024076c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 0x7f4bfc16f0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4c024076c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10e780 0x7f4bfc0f8c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4c024076c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0f9870 con 0x7f4bfc10cc50 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4c024076c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0f99e0 con 0x7f4bfc10e780 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4c024076c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0f9ba0 con 0x7f4bfc10ddd0 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4bfb7fe6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 0x7f4bfc16f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4bfb7fe6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 0x7f4bfc16f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:35432/0 (socket says 10.20.193.70:35432) 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4bfb7fe6c0 1 -- 10.20.193.70:0/2315890568 learned_addr learned my addr 10.20.193.70:0/2315890568 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4bfb7fe6c0 1 -- 10.20.193.70:0/2315890568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 msgr2=0x7f4bfc16f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4bfb7fe6c0 1 -- 10.20.193.70:0/2315890568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 msgr2=0x7f4bfc16f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4bfb7fe6c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 0x7f4bfc16f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4bfb7fe6c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 0x7f4bfc16f0f0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:32.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.216+0000 7f4bfbfff6c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4bfc10cc50 0x7f4bfc0f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4c009796c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10e780 0x7f4bfc0f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4c009796c0 1 -- 10.20.193.70:0/2315890568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10e780 msgr2=0x7f4bfc0f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4c009796c0 1 -- 10.20.193.70:0/2315890568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10e780 msgr2=0x7f4bfc0f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4c009796c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10e780 0x7f4bfc0f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4c009796c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10e780 0x7f4bfc0f8c20 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4bfbfff6c0 1 -- 10.20.193.70:0/2315890568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 msgr2=0x7f4bfc16f0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4bfbfff6c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 0x7f4bfc16f0f0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4bfbfff6c0 1 -- 10.20.193.70:0/2315890568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10e780 msgr2=0x7f4bfc0f8c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4bfbfff6c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10e780 0x7f4bfc0f8c20 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4bfbfff6c0 1 -- 10.20.193.70:0/2315890568 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf000a5b0 con 0x7f4bfc10cc50 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.217+0000 7f4bfbfff6c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4bfc10cc50 0x7f4bfc0f83e0 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4be8004750 tx=0x7f4be800bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f4bf97fa6c0 1 -- 10.20.193.70:0/2315890568 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4be8002ba0 con 0x7f4bfc10cc50 2026-02-13T03:43:32.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f4bf97fa6c0 1 -- 10.20.193.70:0/2315890568 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4be80044f0 con 0x7f4bfc10cc50 2026-02-13T03:43:32.222 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f4bf97fa6c0 1 -- 10.20.193.70:0/2315890568 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4be800dd30 con 0x7f4bfc10cc50 2026-02-13T03:43:32.222 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc0f9e20 con 0x7f4bfc10cc50 2026-02-13T03:43:32.222 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc0fa2d0 con 0x7f4bfc10cc50 2026-02-13T03:43:32.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f00faa486c0 1 -- 10.20.193.70:0/1574008705 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 msgr2=0x7f00f410af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f00faa486c0 1 --2- 10.20.193.70:0/1574008705 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 0x7f00f410af80 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=7042439386864034388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00e0009b00 tx=0x7f00e002eeb0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f00faa486c0 1 -- 10.20.193.70:0/1574008705 shutdown_connections 2026-02-13T03:43:32.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f00faa486c0 1 --2- 10.20.193.70:0/1574008705 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 0x7f00f410ce40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f00faa486c0 1 --2- 10.20.193.70:0/1574008705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 0x7f00f410bfa0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f00faa486c0 1 --2- 10.20.193.70:0/1574008705 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 0x7f00f410af80 unknown :-1 s=CLOSED pgs=130 gs=2 cs=0 l=1 c_cookie=7042439386864034388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f00faa486c0 1 -- 10.20.193.70:0/1574008705 >> 10.20.193.70:0/1574008705 conn(0x7f00f40e8510 msgr2=0x7f00f4108940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f00faa486c0 1 -- 10.20.193.70:0/1574008705 shutdown_connections 2026-02-13T03:43:32.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.218+0000 7f00faa486c0 1 -- 10.20.193.70:0/1574008705 wait complete. 2026-02-13T03:43:32.224 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.219+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc173040 con 0x7f4bfc10cc50 2026-02-13T03:43:32.224 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.219+0000 7f4bf97fa6c0 1 -- 10.20.193.70:0/2315890568 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f4be8002d00 con 0x7f4bfc10cc50 2026-02-13T03:43:32.224 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.219+0000 7f4bf97fa6c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4bd003f870 0x7f4bd005fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.224 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.219+0000 7f00faa486c0 1 Processor -- start 2026-02-13T03:43:32.224 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.219+0000 7f00faa486c0 1 -- start start 2026-02-13T03:43:32.225 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00faa486c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 0x7f00f40f4070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.225 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f4bf97fa6c0 1 -- 10.20.193.70:0/2315890568 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f4be8051140 con 0x7f4bfc10cc50 2026-02-13T03:43:32.225 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00faa486c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 0x7f00f40f46c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.225 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00faa486c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 0x7f00f40f52b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.226 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f4bfb7fe6c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4bd003f870 0x7f4bd005fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.226 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f3fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 0x7f00f40f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f3fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 0x7f00f40f4070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43996/0 (socket says 10.20.193.70:43996) 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f3fff6c0 1 -- 10.20.193.70:0/2508478577 learned_addr learned my addr 10.20.193.70:0/2508478577 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00faa486c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00f40f5a40 con 0x7f00f410ab90 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f00f40f5bb0 con 0x7f00f410c4e0 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f00f40f5d70 con 0x7f00f410bb30 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f8fbe6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 0x7f00f40f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f37fe6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 0x7f00f40f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f8fbe6c0 1 -- 10.20.193.70:0/2508478577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 msgr2=0x7f00f40f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f8fbe6c0 1 -- 10.20.193.70:0/2508478577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 msgr2=0x7f00f40f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f8fbe6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 0x7f00f40f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:32.227 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f8fbe6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 0x7f00f40f52b0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:32.228 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f4bfb7fe6c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4bd003f870 0x7f4bd005fd20 secure :-1 s=READY pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bec009260 tx=0x7f4bec009050 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.229 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f37fe6c0 1 -- 10.20.193.70:0/2508478577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 msgr2=0x7f00f40f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T03:43:32.229 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f37fe6c0 1 -- 10.20.193.70:0/2508478577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 msgr2=0x7f00f40f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:32.229 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f37fe6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 0x7f00f40f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:32.229 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f37fe6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 0x7f00f40f46c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:32.229 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f3fff6c0 1 -- 10.20.193.70:0/2508478577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 msgr2=0x7f00f40f46c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:32.229 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f3fff6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 0x7f00f40f46c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.229 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f3fff6c0 1 -- 10.20.193.70:0/2508478577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 msgr2=0x7f00f40f52b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:32.229 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f3fff6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 0x7f00f40f52b0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.229 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.220+0000 7f00f3fff6c0 1 -- 10.20.193.70:0/2508478577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e00094c0 con 0x7f00f410ab90 2026-02-13T03:43:32.230 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.221+0000 7f00f3fff6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 0x7f00f40f4070 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00e0004600 tx=0x7f00e00027f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.230 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.222+0000 7f00f17fa6c0 1 -- 10.20.193.70:0/2508478577 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00e0031d20 con 0x7f00f410ab90 2026-02-13T03:43:32.230 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.222+0000 7f00f17fa6c0 1 -- 10.20.193.70:0/2508478577 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f00e0031e80 con 0x7f00f410ab90 2026-02-13T03:43:32.230 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.222+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f40f5ff0 con 0x7f00f410ab90 2026-02-13T03:43:32.230 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.222+0000 7f00f17fa6c0 1 -- 10.20.193.70:0/2508478577 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00e0037500 con 0x7f00f410ab90 2026-02-13T03:43:32.230 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f4170e30 con 0x7f00f410ab90 2026-02-13T03:43:32.230 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f4bf97fa6c0 1 -- 10.20.193.70:0/2315890568 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4be800d380 con 0x7f4bfc10cc50 2026-02-13T03:43:32.230 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/3963148534 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810cc50 msgr2=0x7f2b0810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.231 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/3963148534 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810cc50 0x7f2b0810d040 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=4287427054419960191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2afc0098a0 tx=0x7f2afc02ec40 comp rx=0 tx=0).stop 2026-02-13T03:43:32.231 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f00f17fa6c0 1 -- 10.20.193.70:0/2508478577 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f00e0031070 con 0x7f00f410ab90 2026-02-13T03:43:32.232 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/3963148534 shutdown_connections 2026-02-13T03:43:32.232 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/3963148534 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b0810e780 0x7f2b0816f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.232 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/3963148534 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b0810ddd0 0x7f2b0810e240 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.232 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/3963148534 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810cc50 0x7f2b0810d040 unknown :-1 s=CLOSED pgs=133 gs=1 cs=0 l=1 c_cookie=4287427054419960191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.232 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/3963148534 >> 10.20.193.70:0/3963148534 conn(0x7f2b080ea370 msgr2=0x7f2b0810a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.232 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/3963148534 shutdown_connections 2026-02-13T03:43:32.232 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.224+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/3963148534 wait complete. 2026-02-13T03:43:32.232 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.224+0000 7f00f17fa6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00c803f8f0 0x7f00c805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.233 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.223+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f93fc1727b0 con 0x7f93fc10e7e0 2026-02-13T03:43:32.233 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.224+0000 7f00f37fe6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00c803f8f0 0x7f00c805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.233 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.224+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f4110040 con 0x7f00f410ab90 2026-02-13T03:43:32.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.224+0000 7f2b0d2646c0 1 Processor -- start 2026-02-13T03:43:32.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.224+0000 7f2b0d2646c0 1 -- start start 2026-02-13T03:43:32.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.224+0000 7f2b0d2646c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b0810cc50 0x7f2b080f63e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.224+0000 7f00f17fa6c0 1 -- 10.20.193.70:0/2508478577 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f00e00766d0 con 0x7f00f410ab90 2026-02-13T03:43:32.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.224+0000 7f2b0d2646c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810ddd0 0x7f2b0816f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b0d2646c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b0810e780 0x7f2b080f6c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b065756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810ddd0 0x7f2b0816f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f00f37fe6c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00c803f8f0 0x7f00c805fda0 secure :-1 s=READY pgs=70 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00e4004750 tx=0x7f00e4005ac0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b065756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810ddd0 0x7f2b0816f110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:44014/0 (socket says 10.20.193.70:44014) 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b065756c0 1 -- 10.20.193.70:0/1116823692 learned_addr learned my addr 10.20.193.70:0/1116823692 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b080f7870 con 0x7f2b0810ddd0 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2b080f79e0 con 0x7f2b0810e780 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b080f7ba0 con 0x7f2b0810cc50 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b065756c0 1 -- 10.20.193.70:0/1116823692 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b0810cc50 msgr2=0x7f2b080f63e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b065756c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b0810cc50 0x7f2b080f63e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b065756c0 1 -- 10.20.193.70:0/1116823692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b0810e780 msgr2=0x7f2b080f6c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b065756c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b0810e780 0x7f2b080f6c40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b065756c0 1 -- 10.20.193.70:0/1116823692 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc0094c0 con 0x7f2b0810ddd0 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.225+0000 7f2b065756c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810ddd0 0x7f2b0816f110 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2af0005980 tx=0x7f2af000bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.226+0000 7f93e77fe6c0 1 -- 10.20.193.70:0/3202638389 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f93f0014590 con 0x7f93fc10e7e0 2026-02-13T03:43:32.237 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.229+0000 7f2ae7fff6c0 1 -- 10.20.193.70:0/1116823692 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2af0004250 con 0x7f2b0810ddd0 2026-02-13T03:43:32.237 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.229+0000 7f2ae7fff6c0 1 -- 10.20.193.70:0/1116823692 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2af000be30 con 0x7f2b0810ddd0 2026-02-13T03:43:32.237 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.229+0000 7f2ae7fff6c0 1 -- 10.20.193.70:0/1116823692 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2af0011070 con 0x7f2b0810ddd0 2026-02-13T03:43:32.237 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.229+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b080f7e80 con 0x7f2b0810ddd0 2026-02-13T03:43:32.237 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.229+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b080f8310 con 0x7f2b0810ddd0 2026-02-13T03:43:32.237 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.229+0000 7f00f17fa6c0 1 -- 10.20.193.70:0/2508478577 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00e00376d0 con 0x7f00f410ab90 2026-02-13T03:43:32.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.230+0000 7f2ae7fff6c0 1 -- 10.20.193.70:0/1116823692 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f2af00028c0 con 0x7f2b0810ddd0 2026-02-13T03:43:32.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.230+0000 7f2ae7fff6c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2adc043e00 0x7f2adc0642b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.230+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b08173010 con 0x7f2b0810ddd0 2026-02-13T03:43:32.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.230+0000 7f2b06d766c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2adc043e00 0x7f2adc0642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.231+0000 7f2b06d766c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2adc043e00 0x7f2adc0642b0 secure :-1 s=READY pgs=71 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2afc02f150 tx=0x7f2afc0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.231+0000 7f2ae7fff6c0 1 -- 10.20.193.70:0/1116823692 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f2af0051250 con 0x7f2b0810ddd0 2026-02-13T03:43:32.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.233+0000 7f2ae7fff6c0 1 -- 10.20.193.70:0/1116823692 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2af0008730 con 0x7f2b0810ddd0 2026-02-13T03:43:32.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f93d803f8f0 msgr2=0x7f93d805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f93d803f8f0 0x7f93d805fda0 secure :-1 s=READY pgs=61 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93f4005980 tx=0x7f93f4005910 comp rx=0 tx=0).stop 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10e7e0 msgr2=0x7f93fc0f9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10e7e0 0x7f93fc0f9810 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93f0006ea0 tx=0x7f93f0006530 comp rx=0 tx=0).stop 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 shutdown_connections 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f93d803f8f0 0x7f93d805fda0 unknown :-1 s=CLOSED pgs=61 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f93fc10e7e0 0x7f93fc0f9810 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93fc10de30 0x7f93fc16f150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 --2- 10.20.193.70:0/3202638389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc10ccb0 0x7f93fc0f8fd0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 >> 10.20.193.70:0/3202638389 conn(0x7f93fc0ea3d0 msgr2=0x7f93fc060550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 shutdown_connections 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.234+0000 7f940498c6c0 1 -- 10.20.193.70:0/3202638389 wait complete. 2026-02-13T03:43:32.239 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.235+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}] v 0) -- 0x7f3b5c172800 con 0x7f3b5c10cc50 2026-02-13T03:43:32.240 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.237+0000 7f3b4affd6c0 1 -- 10.20.193.70:0/4269796726 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}]=0 v24)=0 v24) ==== 141+0+0 (secure 0 0 0) 0x7f3b5800b040 con 0x7f3b5c10cc50 2026-02-13T03:43:32.241 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.243 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.241+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3b3803f940 msgr2=0x7f3b3805fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.243 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.241+0000 7f3b641146c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3b3803f940 0x7f3b3805fdf0 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b4c005fd0 tx=0x7f3b4c005910 comp rx=0 tx=0).stop 2026-02-13T03:43:32.243 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.241+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10cc50 msgr2=0x7f3b5c0f85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.243 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.241+0000 7f3b641146c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10cc50 0x7f3b5c0f85a0 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b5800a970 tx=0x7f3b5800ae40 comp rx=0 tx=0).stop 2026-02-13T03:43:32.246 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.245+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 shutdown_connections 2026-02-13T03:43:32.246 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.245+0000 7f3b641146c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3b3803f940 0x7f3b3805fdf0 unknown :-1 s=CLOSED pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.246 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.245+0000 7f3b641146c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b5c10e780 0x7f3b5c0f8de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.246 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.245+0000 7f3b641146c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3b5c10ddd0 0x7f3b5c16f0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.246 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.245+0000 7f3b641146c0 1 --2- 10.20.193.70:0/4269796726 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3b5c10cc50 0x7f3b5c0f85a0 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.246 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.245+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 >> 10.20.193.70:0/4269796726 conn(0x7f3b5c0ea370 msgr2=0x7f3b5c0ec0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.246 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.245+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 shutdown_connections 2026-02-13T03:43:32.246 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.245+0000 7f3b641146c0 1 -- 10.20.193.70:0/4269796726 wait complete. 2026-02-13T03:43:32.275 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.277 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.277 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.279+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f4d241701e0 con 0x7f4d2410cc50 2026-02-13T03:43:32.283 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.282+0000 7f4d12ffd6c0 1 -- 10.20.193.70:0/1724790916 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v25)=0 v25) ==== 120+0+0 (secure 0 0 0) 0x7f4d241701e0 con 0x7f4d2410cc50 2026-02-13T03:43:32.285 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.283+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/83284493 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 msgr2=0x7f3f0810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.285 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.283+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/83284493 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 0x7f3f0810d040 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=7806064039252013654 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ef4009970 tx=0x7f3ef402ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:32.285 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.283+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/83284493 shutdown_connections 2026-02-13T03:43:32.285 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.283+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/83284493 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f0810e780 0x7f3f0816f110 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.285 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.283+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/83284493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f0810ddd0 0x7f3f0810e240 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.285 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.283+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/83284493 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 0x7f3f0810d040 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=7806064039252013654 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.286 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.283+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/83284493 >> 10.20.193.70:0/83284493 conn(0x7f3f080ea370 msgr2=0x7f3f0810a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.286 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.283+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/83284493 shutdown_connections 2026-02-13T03:43:32.286 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.283+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/83284493 wait complete. 2026-02-13T03:43:32.286 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f0e7bc6c0 1 Processor -- start 2026-02-13T03:43:32.286 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f5e7816fde0 con 0x7f5e7810c3d0 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f0e7bc6c0 1 -- start start 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f0e7bc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 0x7f3f080f6190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f0e7bc6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f0810ddd0 0x7f3f0816f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f0e7bc6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f0810e780 0x7f3f080f69f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f07fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 0x7f3f080f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f07fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 0x7f3f080f6190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:44024/0 (socket says 10.20.193.70:44024) 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f07fff6c0 1 -- 10.20.193.70:0/835560944 learned_addr learned my addr 10.20.193.70:0/835560944 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f077fe6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f0810ddd0 0x7f3f0816f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f080f7620 con 0x7f3f0810cc50 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.284+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3f080f7790 con 0x7f3f0810ddd0 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3f080f7950 con 0x7f3f0810e780 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f0cd326c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f0810e780 0x7f3f080f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f07fff6c0 1 -- 10.20.193.70:0/835560944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f0810e780 msgr2=0x7f3f080f69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f07fff6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f0810e780 0x7f3f080f69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f07fff6c0 1 -- 10.20.193.70:0/835560944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f0810ddd0 msgr2=0x7f3f0816f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f07fff6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f0810ddd0 0x7f3f0816f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f07fff6c0 1 -- 10.20.193.70:0/835560944 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef4009590 con 0x7f3f0810cc50 2026-02-13T03:43:32.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f077fe6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f0810ddd0 0x7f3f0816f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:43:32.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f0cd326c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f0810e780 0x7f3f080f69f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:43:32.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.285+0000 7f3f07fff6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 0x7f3f080f6190 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ef4031fd0 tx=0x7f3ef4002960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.286+0000 7f5e66ffd6c0 1 -- 10.20.193.70:0/3163468032 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7f5e6c008030 con 0x7f5e7810c3d0 2026-02-13T03:43:32.290 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.286+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4d0003f8f0 msgr2=0x7f4d0005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.290 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.286+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4d0003f8f0 0x7f4d0005fda0 secure :-1 s=READY pgs=66 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d1800b940 tx=0x7f4d180023a0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.290 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.286+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410cc50 msgr2=0x7f4d24113640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.290 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.286+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410cc50 0x7f4d24113640 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d14005980 tx=0x7f4d1400bbd0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.290 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.287+0000 7f3f057fa6c0 1 -- 10.20.193.70:0/835560944 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ef40071c0 con 0x7f3f0810cc50 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.287+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f080f7bd0 con 0x7f3f0810cc50 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.287+0000 7f3f057fa6c0 1 -- 10.20.193.70:0/835560944 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3ef40077e0 con 0x7f3f0810cc50 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.287+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f080f8050 con 0x7f3f0810cc50 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.287+0000 7f3f057fa6c0 1 -- 10.20.193.70:0/835560944 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ef40375c0 con 0x7f3f0810cc50 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.288+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f08173060 con 0x7f3f0810cc50 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.288+0000 7f3f057fa6c0 1 -- 10.20.193.70:0/835560944 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f3ef4007950 con 0x7f3f0810cc50 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.288+0000 7f3f057fa6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3edc03f8f0 0x7f3edc05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.288+0000 7f3f057fa6c0 1 -- 10.20.193.70:0/835560944 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f3ef4075940 con 0x7f3f0810cc50 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.288+0000 7f3f077fe6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3edc03f8f0 0x7f3edc05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.289+0000 7f3f077fe6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3edc03f8f0 0x7f3edc05fda0 secure :-1 s=READY pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ef8004750 tx=0x7f3ef8005f30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.292 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.289+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 shutdown_connections 2026-02-13T03:43:32.292 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4d0003f8f0 0x7f4d0005fda0 unknown :-1 s=CLOSED pgs=66 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.292 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d2410e780 0x7f4d24114880 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.292 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4d2410ddd0 0x7f4d24113c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.292 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f4d2bfdb6c0 1 --2- 10.20.193.70:0/1724790916 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4d2410cc50 0x7f4d24113640 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.292 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 >> 10.20.193.70:0/1724790916 conn(0x7f4d240ea370 msgr2=0x7f4d2410a750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.292 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 shutdown_connections 2026-02-13T03:43:32.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e5403f8f0 msgr2=0x7f5e5405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e5403f8f0 0x7f5e5405fda0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e68004750 tx=0x7f5e680093b0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5e7810c3d0 msgr2=0x7f5e7816d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5e7810c3d0 0x7f5e7816d6f0 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e6c00c6b0 tx=0x7f5e6c00cb80 comp rx=0 tx=0).stop 2026-02-13T03:43:32.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f4d2bfdb6c0 1 -- 10.20.193.70:0/1724790916 wait complete. 2026-02-13T03:43:32.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 shutdown_connections 2026-02-13T03:43:32.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e5403f8f0 0x7f5e5405fda0 unknown :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5e7810cd80 0x7f5e780f3310 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5e7810c3d0 0x7f5e7816d6f0 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 --2- 10.20.193.70:0/3163468032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e7810b250 0x7f5e780f2ad0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 >> 10.20.193.70:0/3163468032 conn(0x7f5e780e8970 msgr2=0x7f5e780e9040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 shutdown_connections 2026-02-13T03:43:32.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.290+0000 7f5e7ff546c0 1 -- 10.20.193.70:0/3163468032 wait complete. 2026-02-13T03:43:32.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.291+0000 7f3f057fa6c0 1 -- 10.20.193.70:0/835560944 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3ef4034a10 con 0x7f3f0810cc50 2026-02-13T03:43:32.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.292+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fbe601749c0 con 0x7fbe601109f0 2026-02-13T03:43:32.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.294+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7ff338063770 con 0x7ff338110a00 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial070=x;trial127=y;trial177=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:43:32.298 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1467923666' entity='client.admin' 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3466133876' entity='client.admin' 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2627862641' entity='client.admin' 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1732154762' entity='client.admin' 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2410139882' entity='client.admin' 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.299 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1495457486' entity='client.admin' 2026-02-13T03:43:32.300 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2392543583' entity='client.admin' 2026-02-13T03:43:32.300 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:31 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3058323898' entity='client.admin' 2026-02-13T03:43:32.300 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.298+0000 7fbe5cff96c0 1 -- 10.20.193.70:0/153048310 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7fbe5400c8c0 con 0x7fbe601109f0 2026-02-13T03:43:32.303 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbe3403f8f0 msgr2=0x7fbe3405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.303 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbe3403f8f0 0x7fbe3405fda0 secure :-1 s=READY pgs=65 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe4c02f150 tx=0x7fbe4c0023a0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.303 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe601109f0 msgr2=0x7fbe600f8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.303 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe601109f0 0x7fbe600f8e10 secure :-1 s=READY pgs=122 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe54006f60 tx=0x7fbe5400ae10 comp rx=0 tx=0).stop 2026-02-13T03:43:32.303 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 shutdown_connections 2026-02-13T03:43:32.303 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbe3403f8f0 0x7fbe3405fda0 unknown :-1 s=CLOSED pgs=65 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.303 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe601109f0 0x7fbe600f8e10 unknown :-1 s=CLOSED pgs=122 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.303 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe60110040 0x7fbe60171380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.303 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 --2- 10.20.193.70:0/153048310 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe6010eec0 0x7fbe600f85b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.304 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 >> 10.20.193.70:0/153048310 conn(0x7fbe600ec5c0 msgr2=0x7fbe600eeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.304 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 shutdown_connections 2026-02-13T03:43:32.304 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7fbe660a16c0 1 -- 10.20.193.70:0/153048310 wait complete. 2026-02-13T03:43:32.304 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.301+0000 7ff317fff6c0 1 -- 10.20.193.70:0/1577919167 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7ff32800b890 con 0x7ff338110a00 2026-02-13T03:43:32.306 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_use_global_snaprealm_seq_for_subvol', 'False'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.307 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff30c03f870 msgr2=0x7ff30c05fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.307 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff30c03f870 0x7ff30c05fd20 secure :-1 s=READY pgs=64 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff32c02f150 tx=0x7ff32c0023a0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.307 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff338110a00 msgr2=0x7ff33811b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.307 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff338110a00 0x7ff33811b7a0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff328006ea0 tx=0x7ff3280068a0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.307 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 shutdown_connections 2026-02-13T03:43:32.307 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff30c03f870 0x7ff30c05fd20 unknown :-1 s=CLOSED pgs=64 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.307 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff338110a00 0x7ff33811b7a0 unknown :-1 s=CLOSED pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338110050 0x7ff33811abb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 --2- 10.20.193.70:0/1577919167 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff33810eed0 0x7ff33811a560 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 >> 10.20.193.70:0/1577919167 conn(0x7ff3380ec5f0 msgr2=0x7ff33810c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 shutdown_connections 2026-02-13T03:43:32.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.305+0000 7ff33d1236c0 1 -- 10.20.193.70:0/1577919167 wait complete. 2026-02-13T03:43:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.308+0000 7f3e191486c0 1 -- 10.20.193.70:0/2716306360 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 msgr2=0x7f3e141104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.308+0000 7f3e191486c0 1 --2- 10.20.193.70:0/2716306360 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 0x7f3e141104c0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=7848222904852715672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3dfc009970 tx=0x7f3dfc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.308+0000 7f3e191486c0 1 -- 10.20.193.70:0/2716306360 shutdown_connections 2026-02-13T03:43:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.308+0000 7f3e191486c0 1 --2- 10.20.193.70:0/2716306360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e14110a00 0x7f3e14171390 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.308+0000 7f3e191486c0 1 --2- 10.20.193.70:0/2716306360 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 0x7f3e141104c0 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=7848222904852715672 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.308+0000 7f3e191486c0 1 --2- 10.20.193.70:0/2716306360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e1410eed0 0x7f3e1410f2c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.308+0000 7f3e191486c0 1 -- 10.20.193.70:0/2716306360 >> 10.20.193.70:0/2716306360 conn(0x7f3e140ec5f0 msgr2=0x7f3e1410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.308+0000 7f3e191486c0 1 -- 10.20.193.70:0/2716306360 shutdown_connections 2026-02-13T03:43:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.308+0000 7f3e191486c0 1 -- 10.20.193.70:0/2716306360 wait complete. 2026-02-13T03:43:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 Processor -- start 2026-02-13T03:43:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 -- start start 2026-02-13T03:43:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e1410eed0 0x7f3e140f8580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 0x7f3e14171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e14110a00 0x7f3e140f8de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e140f9a10 con 0x7f3e14110050 2026-02-13T03:43:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3e140f9b80 con 0x7f3e1410eed0 2026-02-13T03:43:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e140f9d40 con 0x7f3e14110a00 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e125756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 0x7f3e14171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e125756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 0x7f3e14171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:44044/0 (socket says 10.20.193.70:44044) 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e125756c0 1 -- 10.20.193.70:0/1706360416 learned_addr learned my addr 10.20.193.70:0/1706360416 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e12d766c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e1410eed0 0x7f3e140f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e135776c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e14110a00 0x7f3e140f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e125756c0 1 -- 10.20.193.70:0/1706360416 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e14110a00 msgr2=0x7f3e140f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e125756c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e14110a00 0x7f3e140f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e125756c0 1 -- 10.20.193.70:0/1706360416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e1410eed0 msgr2=0x7f3e140f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e12d766c0 1 -- 10.20.193.70:0/1706360416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e1410eed0 msgr2=0x7f3e140f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e12d766c0 1 -- 10.20.193.70:0/1706360416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e1410eed0 msgr2=0x7f3e140f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e12d766c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e1410eed0 0x7f3e140f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T03:43:32.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e12d766c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e1410eed0 0x7f3e140f8580 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e125756c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e1410eed0 0x7f3e140f8580 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e125756c0 1 -- 10.20.193.70:0/1706360416 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc009590 con 0x7f3e14110050 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e125756c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 0x7f3e14171390 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3dfc0092b0 tx=0x7f3dfc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3df3fff6c0 1 -- 10.20.193.70:0/1706360416 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3dfc002be0 con 0x7f3e14110050 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e140f9fc0 con 0x7f3e14110050 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3df3fff6c0 1 -- 10.20.193.70:0/1706360416 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3dfc007680 con 0x7f3e14110050 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3df3fff6c0 1 -- 10.20.193.70:0/1706360416 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3dfc037620 con 0x7f3e14110050 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.309+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e140fa440 con 0x7f3e14110050 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.310+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e140fa660 con 0x7f3e14110050 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.310+0000 7f3df3fff6c0 1 -- 10.20.193.70:0/1706360416 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f3dfc007cb0 con 0x7f3e14110050 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.310+0000 7f3df3fff6c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3de803f8f0 0x7f3de805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.311+0000 7f3df3fff6c0 1 -- 10.20.193.70:0/1706360416 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f3dfc075730 con 0x7f3e14110050 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.311+0000 7f3e12d766c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3de803f8f0 0x7f3de805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.311+0000 7f3e12d766c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3de803f8f0 0x7f3de805fda0 secure :-1 s=READY pgs=73 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e08005980 tx=0x7f3e08005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.316 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.317 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.313+0000 7f3df3fff6c0 1 -- 10.20.193.70:0/1706360416 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3dfc034de0 con 0x7f3e14110050 2026-02-13T03:43:32.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.344+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f65701104c0 con 0x7f657010eed0 2026-02-13T03:43:32.348 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.347+0000 7f655e7fc6c0 1 -- 10.20.193.70:0/4211795200 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7f6560035040 con 0x7f657010eed0 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f654c03f8f0 msgr2=0x7f654c05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f654c03f8f0 0x7f654c05fda0 secure :-1 s=READY pgs=68 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6564004770 tx=0x7f6564006c90 comp rx=0 tx=0).stop 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 msgr2=0x7f65700f86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 0x7f65700f86a0 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65600092b0 tx=0x7f65600047b0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 shutdown_connections 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f654c03f8f0 0x7f654c05fda0 unknown :-1 s=CLOSED pgs=68 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6570110a00 0x7f65700f8f00 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6570110050 0x7f6570171390 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 --2- 10.20.193.70:0/4211795200 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f657010eed0 0x7f65700f86a0 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.352 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 >> 10.20.193.70:0/4211795200 conn(0x7f65700ec5f0 msgr2=0x7f65700eeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.353 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 shutdown_connections 2026-02-13T03:43:32.353 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.350+0000 7f65776e06c0 1 -- 10.20.193.70:0/4211795200 wait complete. 2026-02-13T03:43:32.353 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.351+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fd67410e240 con 0x7fd67410cc50 2026-02-13T03:43:32.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.354+0000 7fd670ff96c0 1 -- 10.20.193.70:0/4176614086 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v30)=0 v30) ==== 111+0+0 (secure 0 0 0) 0x7fd6600348d0 con 0x7fd67410cc50 2026-02-13T03:43:32.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.355+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f00f40ecae0 con 0x7f00f410ab90 2026-02-13T03:43:32.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f4bfc0fa690 con 0x7f4bfc10cc50 2026-02-13T03:43:32.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd64803f940 msgr2=0x7fd64805fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd64803f940 0x7fd64805fdf0 secure :-1 s=READY pgs=67 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd664005980 tx=0x7fd664005910 comp rx=0 tx=0).stop 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 msgr2=0x7fd6740f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 0x7fd6740f2d30 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd660004600 tx=0x7fd660031730 comp rx=0 tx=0).stop 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 shutdown_connections 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd64803f940 0x7fd64805fdf0 unknown :-1 s=CLOSED pgs=67 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd67410e780 0x7fd6740f3590 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd67410ddd0 0x7fd67416f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 --2- 10.20.193.70:0/4176614086 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd67410cc50 0x7fd6740f2d30 unknown :-1 s=CLOSED pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 >> 10.20.193.70:0/4176614086 conn(0x7fd6740ea370 msgr2=0x7fd674109b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 shutdown_connections 2026-02-13T03:43:32.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7fd679db46c0 1 -- 10.20.193.70:0/4176614086 wait complete. 2026-02-13T03:43:32.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.356+0000 7f00f17fa6c0 1 -- 10.20.193.70:0/2508478577 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f00e00348d0 con 0x7f00f410ab90 2026-02-13T03:43:32.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.357+0000 7f4bf97fa6c0 1 -- 10.20.193.70:0/2315890568 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v31)=0 v31) ==== 108+0+0 (secure 0 0 0) 0x7f4be800f040 con 0x7f4bfc10cc50 2026-02-13T03:43:32.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.358+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f2b0810e240 con 0x7f2b0810ddd0 2026-02-13T03:43:32.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.362 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.362 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.358+0000 7f2ae7fff6c0 1 -- 10.20.193.70:0/1116823692 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v31)=0 v31) ==== 106+0+0 (secure 0 0 0) 0x7f2af0008040 con 0x7f2b0810ddd0 2026-02-13T03:43:32.362 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00c803f8f0 msgr2=0x7f00c805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00c803f8f0 0x7f00c805fda0 secure :-1 s=READY pgs=70 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00e4004750 tx=0x7f00e4005ac0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 msgr2=0x7f00f40f4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 0x7f00f40f4070 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00e0004600 tx=0x7f00e00027f0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 shutdown_connections 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00c803f8f0 0x7f00c805fda0 unknown :-1 s=CLOSED pgs=70 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f00f410c4e0 0x7f00f40f52b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00f410bb30 0x7f00f40f46c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 --2- 10.20.193.70:0/2508478577 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00f410ab90 0x7f00f40f4070 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 >> 10.20.193.70:0/2508478577 conn(0x7f00f40e8510 msgr2=0x7f00f40ea1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 shutdown_connections 2026-02-13T03:43:32.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.359+0000 7f00faa486c0 1 -- 10.20.193.70:0/2508478577 wait complete. 2026-02-13T03:43:32.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4bd003f870 msgr2=0x7f4bd005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4bd003f870 0x7f4bd005fd20 secure :-1 s=READY pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bec009260 tx=0x7f4bec009050 comp rx=0 tx=0).stop 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4bfc10cc50 msgr2=0x7f4bfc0f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4bfc10cc50 0x7f4bfc0f83e0 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4be8004750 tx=0x7f4be800bae0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 shutdown_connections 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4bd003f870 0x7f4bd005fd20 unknown :-1 s=CLOSED pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4bfc10e780 0x7f4bfc0f8c20 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bfc10ddd0 0x7f4bfc16f0f0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 --2- 10.20.193.70:0/2315890568 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4bfc10cc50 0x7f4bfc0f83e0 unknown :-1 s=CLOSED pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 >> 10.20.193.70:0/2315890568 conn(0x7f4bfc0ea370 msgr2=0x7f4bfc0605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 shutdown_connections 2026-02-13T03:43:32.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f4c024076c0 1 -- 10.20.193.70:0/2315890568 wait complete. 2026-02-13T03:43:32.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2adc043e00 msgr2=0x7f2adc0642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2adc043e00 0x7f2adc0642b0 secure :-1 s=READY pgs=71 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2afc02f150 tx=0x7f2afc0023a0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810ddd0 msgr2=0x7f2b0816f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810ddd0 0x7f2b0816f110 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2af0005980 tx=0x7f2af000bbd0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 shutdown_connections 2026-02-13T03:43:32.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2adc043e00 0x7f2adc0642b0 unknown :-1 s=CLOSED pgs=71 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b0810e780 0x7f2b080f6c40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b0810ddd0 0x7f2b0816f110 unknown :-1 s=CLOSED pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 --2- 10.20.193.70:0/1116823692 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b0810cc50 0x7f2b080f63e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 >> 10.20.193.70:0/1116823692 conn(0x7f2b080ea370 msgr2=0x7f2b080ec910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 shutdown_connections 2026-02-13T03:43:32.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.360+0000 7f2b0d2646c0 1 -- 10.20.193.70:0/1116823692 wait complete. 2026-02-13T03:43:32.403 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.402+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f3f0808f5b0 con 0x7f3f0810cc50 2026-02-13T03:43:32.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.404+0000 7f3f057fa6c0 1 -- 10.20.193.70:0/835560944 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f3ef4007e30 con 0x7f3f0810cc50 2026-02-13T03:43:32.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3edc03f8f0 msgr2=0x7f3edc05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3edc03f8f0 0x7f3edc05fda0 secure :-1 s=READY pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ef8004750 tx=0x7f3ef8005f30 comp rx=0 tx=0).stop 2026-02-13T03:43:32.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 msgr2=0x7f3f080f6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 0x7f3f080f6190 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ef4031fd0 tx=0x7f3ef4002960 comp rx=0 tx=0).stop 2026-02-13T03:43:32.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 shutdown_connections 2026-02-13T03:43:32.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3edc03f8f0 0x7f3edc05fda0 unknown :-1 s=CLOSED pgs=72 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f0810e780 0x7f3f080f69f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3f0810ddd0 0x7f3f0816f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 --2- 10.20.193.70:0/835560944 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3f0810cc50 0x7f3f080f6190 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 >> 10.20.193.70:0/835560944 conn(0x7f3f080ea370 msgr2=0x7f3f080ec320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.407+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 shutdown_connections 2026-02-13T03:43:32.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.408+0000 7f3f0e7bc6c0 1 -- 10.20.193.70:0/835560944 wait complete. 2026-02-13T03:43:32.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.426+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f3e14174c10 con 0x7f3e14110050 2026-02-13T03:43:32.429 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.428+0000 7f3df3fff6c0 1 -- 10.20.193.70:0/1706360416 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v33)=0 v33) ==== 125+0+0 (secure 0 0 0) 0x7f3e14174c10 con 0x7f3e14110050 2026-02-13T03:43:32.433 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3de803f8f0 msgr2=0x7f3de805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.433 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3de803f8f0 0x7f3de805fda0 secure :-1 s=READY pgs=73 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e08005980 tx=0x7f3e08005910 comp rx=0 tx=0).stop 2026-02-13T03:43:32.433 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 msgr2=0x7f3e14171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.433 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 0x7f3e14171390 secure :-1 s=READY pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3dfc0092b0 tx=0x7f3dfc0047b0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.433 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 shutdown_connections 2026-02-13T03:43:32.433 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3de803f8f0 0x7f3de805fda0 unknown :-1 s=CLOSED pgs=73 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.434 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e14110a00 0x7f3e140f8de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.434 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3e14110050 0x7f3e14171390 unknown :-1 s=CLOSED pgs=138 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.434 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 --2- 10.20.193.70:0/1706360416 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3e1410eed0 0x7f3e140f8580 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.434 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 >> 10.20.193.70:0/1706360416 conn(0x7f3e140ec5f0 msgr2=0x7f3e140eeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.434 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 shutdown_connections 2026-02-13T03:43:32.434 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.431+0000 7f3e191486c0 1 -- 10.20.193.70:0/1706360416 wait complete. 2026-02-13T03:43:32.436 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.437 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.437 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.437 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.473 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.473 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0c5cf8b4-088e-11f1-b830-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial070') 2026-02-13T03:43:32.473 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config dump 2026-02-13T03:43:32.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:32.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='client.14187 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial070=x;trial127=y;trial177=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1467923666' entity='client.admin' 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3466133876' entity='client.admin' 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2627862641' entity='client.admin' 2026-02-13T03:43:32.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1732154762' entity='client.admin' 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2410139882' entity='client.admin' 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:43:32.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:32.477 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1495457486' entity='client.admin' 2026-02-13T03:43:32.477 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2392543583' entity='client.admin' 2026-02-13T03:43:32.477 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:31 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3058323898' entity='client.admin' 2026-02-13T03:43:32.558 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 systemd[1]: Started Ceph mgr.z for 0c5cf8b4-088e-11f1-b830-d404e6e7d460. 2026-02-13T03:43:32.629 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:32.748 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3189162522 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 msgr2=0x7f4a6410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.748 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3189162522 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 0x7f4a6410d040 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=1545288750967361047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a54009970 tx=0x7f4a5402ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:32.748 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3189162522 shutdown_connections 2026-02-13T03:43:32.748 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3189162522 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a6410e780 0x7f4a6416f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.748 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3189162522 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a6410ddd0 0x7f4a6410e240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3189162522 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 0x7f4a6410d040 unknown :-1 s=CLOSED pgs=141 gs=1 cs=0 l=1 c_cookie=1545288750967361047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3189162522 >> 10.20.193.70:0/3189162522 conn(0x7f4a640ea370 msgr2=0x7f4a6410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3189162522 shutdown_connections 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3189162522 wait complete. 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 Processor -- start 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 -- start start 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 0x7f4a640f63e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a6410ddd0 0x7f4a6416f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a6410e780 0x7f4a640f6c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a640f7870 con 0x7f4a6410cc50 2026-02-13T03:43:32.749 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4a640f79e0 con 0x7f4a6410e780 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.744+0000 7f4a6b3ec6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4a640f7ba0 con 0x7f4a6410ddd0 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6915d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 0x7f4a640f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6915d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 0x7f4a640f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:44060/0 (socket says 10.20.193.70:44060) 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6915d6c0 1 -- 10.20.193.70:0/3605404914 learned_addr learned my addr 10.20.193.70:0/3605404914 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6895c6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a6410ddd0 0x7f4a6416f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6915d6c0 1 -- 10.20.193.70:0/3605404914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a6410ddd0 msgr2=0x7f4a6416f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6915d6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a6410ddd0 0x7f4a6416f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6915d6c0 1 -- 10.20.193.70:0/3605404914 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a6410e780 msgr2=0x7f4a640f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6915d6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a6410e780 0x7f4a640f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6915d6c0 1 -- 10.20.193.70:0/3605404914 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a54009590 con 0x7f4a6410cc50 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6915d6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 0x7f4a640f63e0 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a540092b0 tx=0x7f4a540047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.750 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a527fc6c0 1 -- 10.20.193.70:0/3605404914 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a54002be0 con 0x7f4a6410cc50 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a527fc6c0 1 -- 10.20.193.70:0/3605404914 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4a54002d40 con 0x7f4a6410cc50 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a640f7e20 con 0x7f4a6410cc50 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a527fc6c0 1 -- 10.20.193.70:0/3605404914 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4a54037380 con 0x7f4a6410cc50 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a640f82a0 con 0x7f4a6410cc50 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a64172ff0 con 0x7f4a6410cc50 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.745+0000 7f4a527fc6c0 1 -- 10.20.193.70:0/3605404914 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f4a54007a10 con 0x7f4a6410cc50 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.746+0000 7f4a527fc6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4a4003f8f0 0x7f4a4005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.746+0000 7f4a527fc6c0 1 -- 10.20.193.70:0/3605404914 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f4a54075680 con 0x7f4a6410cc50 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.746+0000 7f4a6895c6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4a4003f8f0 0x7f4a4005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:32.751 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.746+0000 7f4a6895c6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4a4003f8f0 0x7f4a4005fda0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a58005980 tx=0x7f4a58005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:32.752 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.748+0000 7f4a527fc6c0 1 -- 10.20.193.70:0/3605404914 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4a54034890 con 0x7f4a6410cc50 2026-02-13T03:43:32.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.842+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4a64172690 con 0x7f4a6410cc50 2026-02-13T03:43:32.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.842+0000 7f4a527fc6c0 1 -- 10.20.193.70:0/3605404914 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+18690 (secure 0 0 0) 0x7f4a54034890 con 0x7f4a6410cc50 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:global dev auth_debug true 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 * 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:global dev debug_asserts_on_shutdown true 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:global basic log_to_file true 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:global basic log_to_journald false 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:global basic log_to_stderr false 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:global advanced mon_allow_pool_delete true 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-13T03:43:32.845 INFO:teuthology.orchestra.run.trial070.stdout:global advanced mon_cluster_log_to_file true 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global dev ms_die_on_bug true 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global dev ms_die_on_old_message true 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T03:43:32.846 INFO:teuthology.orchestra.run.trial070.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced debug_mon 20/20 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced debug_ms 1/1 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced debug_paxos 20/20 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced mon_data_avail_warn 5 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-13T03:43:32.847 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced client_mount_timeout 30 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced debug_client 20/20 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced debug_mgr 20/20 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced debug_ms 1/1 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-13T03:43:32.848 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:osd dev bdev_debug_aio true 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced bluestore_compression_mode aggressive 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:osd dev bluestore_fsck_on_mount true 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced debug_bluefs 20/20 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced debug_bluestore 20/20 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced debug_ms 1/1 2026-02-13T03:43:32.849 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced debug_osd 20/20 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced debug_rocksdb 10/10 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd dev osd_debug_misdirected_ops true 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd dev osd_debug_op_order true 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd dev osd_debug_shutdown true 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_max_omap_entries_per_request 10000 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-13T03:43:32.850 INFO:teuthology.orchestra.run.trial070.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_memory_target_autotune true 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_objectstore bluestore * 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_op_queue debug_random * 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_recover_clone_overlap true 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced debug_mds 20/20 2026-02-13T03:43:32.851 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced debug_ms 2/2 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced mds_bal_merge_size 5 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced mds_bal_split_bits 3 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced mds_bal_split_size 100 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds dev mds_debug_frag true 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds dev mds_debug_scatterstat true 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced mds_use_global_snaprealm_seq_for_subvol false 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds dev mds_verify_scatter true 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T03:43:32.852 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:client advanced client_mount_timeout 600 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:client advanced debug_client 20/20 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:client advanced debug_ms 1/1 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-13T03:43:32.853 INFO:teuthology.orchestra.run.trial070.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-13T03:43:32.854 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4a4003f8f0 msgr2=0x7f4a4005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4a4003f8f0 0x7f4a4005fda0 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a58005980 tx=0x7f4a58005910 comp rx=0 tx=0).stop 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 msgr2=0x7f4a640f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 0x7f4a640f63e0 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a540092b0 tx=0x7f4a540047b0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 shutdown_connections 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4a4003f8f0 0x7f4a4005fda0 unknown :-1 s=CLOSED pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a6410e780 0x7f4a640f6c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a6410ddd0 0x7f4a6416f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 --2- 10.20.193.70:0/3605404914 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a6410cc50 0x7f4a640f63e0 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 >> 10.20.193.70:0/3605404914 conn(0x7f4a640ea370 msgr2=0x7f4a640ec910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 shutdown_connections 2026-02-13T03:43:32.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:32.843+0000 7f4a6b3ec6c0 1 -- 10.20.193.70:0/3605404914 wait complete. 2026-02-13T03:43:32.863 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mgr[28485]: -- 10.20.193.177:0/1620562928 <== mon.0 v2:10.20.193.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559cdacf7a00 con 0x559cdadcb800 2026-02-13T03:43:32.864 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.566+0000 7f98b0bc3fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T03:43:32.864 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.607+0000 7f98b0bc3fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:43:32.864 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.861+0000 7f98b0bc3fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:43:32.899 INFO:tasks.cephadm:Deploying OSDs... 2026-02-13T03:43:32.899 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:43:32.900 DEBUG:teuthology.orchestra.run.trial070:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T03:43:32.917 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T03:43:32.918 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_1 2026-02-13T03:43:32.974 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T03:43:32.974 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:32.974 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-13T03:43:32.975 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:32.975 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:32.975 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-13 03:43:09.866560011 +0000 2026-02-13T03:43:32.975 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-13 03:41:34.695809382 +0000 2026-02-13T03:43:32.975 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-13 03:41:34.695809382 +0000 2026-02-13T03:43:32.975 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-13 03:41:34.695809382 +0000 2026-02-13T03:43:32.975 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T03:43:33.037 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-13T03:43:33.037 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-13T03:43:33.038 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000159157 s, 3.2 MB/s 2026-02-13T03:43:33.039 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T03:43:33.096 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_2 2026-02-13T03:43:33.152 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T03:43:33.153 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:33.153 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-13T03:43:33.153 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:33.153 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:33.153 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-13 03:43:09.866560011 +0000 2026-02-13T03:43:33.153 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-13 03:41:34.695809382 +0000 2026-02-13T03:43:33.153 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-13 03:41:34.695809382 +0000 2026-02-13T03:43:33.153 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-13 03:41:34.695809382 +0000 2026-02-13T03:43:33.154 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1506049821' entity='client.admin' 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4070933272' entity='client.admin' 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1644767183' entity='client.admin' 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2039414024' entity='client.admin' 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3514082016' entity='client.admin' 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3946461446' entity='client.admin' 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3202638389' entity='client.admin' 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4269796726' entity='client.admin' 2026-02-13T03:43:33.161 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1724790916' entity='client.admin' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3163468032' entity='client.admin' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/153048310' entity='client.admin' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1577919167' entity='client.admin' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4211795200' entity='client.admin' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4176614086' entity='client.admin' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2508478577' entity='client.admin' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/835560944' entity='client.admin' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1706360416' entity='client.admin' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.162 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:43:33.163 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:43:33.163 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:43:33.163 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:33.163 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3605404914' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T03:43:33.163 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:32 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.163 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.870+0000 7f98b0bc3fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:43:33.163 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.877+0000 7f98b0bc3fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:43:33.163 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.883+0000 7f98b0bc3fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.889+0000 7f98b0bc3fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.901+0000 7f98b0bc3fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.926+0000 7f98b0bc3fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.929+0000 7f98b0bc3fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.930+0000 7f98b0bc3fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.937+0000 7f98b0bc3fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.974+0000 7f98b0bc3fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.976+0000 7f98b0bc3fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.980+0000 7f98b0bc3fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.982+0000 7f98b0bc3fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.982+0000 7f98b0bc3fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:43:33.164 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.985+0000 7f98b0bc3fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:43:33.165 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.986+0000 7f98b0bc3fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:43:33.165 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.989+0000 7f98b0bc3fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:43:33.165 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:32.991+0000 7f98b0bc3fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:43:33.165 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.158+0000 7f98b0bc3fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:43:33.165 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.158+0000 7f98b0bc3fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:43:33.215 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-13T03:43:33.215 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-13T03:43:33.215 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000149679 s, 3.4 MB/s 2026-02-13T03:43:33.216 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T03:43:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1506049821' entity='client.admin' 2026-02-13T03:43:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4070933272' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1644767183' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2039414024' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3514082016' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3946461446' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3202638389' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4269796726' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1724790916' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3163468032' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/153048310' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1577919167' entity='client.admin' 2026-02-13T03:43:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4211795200' entity='client.admin' 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4176614086' entity='client.admin' 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2508478577' entity='client.admin' 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/835560944' entity='client.admin' 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1706360416' entity='client.admin' 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:43:33.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:33.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3605404914' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T03:43:33.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:32 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.273 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_3 2026-02-13T03:43:33.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1506049821' entity='client.admin' 2026-02-13T03:43:33.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4070933272' entity='client.admin' 2026-02-13T03:43:33.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1644767183' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2039414024' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3514082016' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3946461446' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3202638389' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4269796726' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1724790916' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3163468032' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/153048310' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1577919167' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4211795200' entity='client.admin' 2026-02-13T03:43:33.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4176614086' entity='client.admin' 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2508478577' entity='client.admin' 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/835560944' entity='client.admin' 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1706360416' entity='client.admin' 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:33.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3605404914' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T03:43:33.301 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:32 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:33.316 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T03:43:33.316 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:33.317 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-13T03:43:33.317 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:33.317 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:33.317 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-13 03:43:09.866560011 +0000 2026-02-13T03:43:33.317 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-13 03:41:34.694809399 +0000 2026-02-13T03:43:33.317 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-13 03:41:34.694809399 +0000 2026-02-13T03:43:33.317 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-13 03:41:34.694809399 +0000 2026-02-13T03:43:33.317 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T03:43:33.380 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-13T03:43:33.380 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-13T03:43:33.380 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000159227 s, 3.2 MB/s 2026-02-13T03:43:33.382 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T03:43:33.438 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_4 2026-02-13T03:43:33.451 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.160+0000 7f98b0bc3fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:43:33.451 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.163+0000 7f98b0bc3fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:43:33.452 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.164+0000 7f98b0bc3fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:43:33.452 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.165+0000 7f98b0bc3fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:43:33.452 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.165+0000 7f98b0bc3fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:43:33.452 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.308+0000 7f98b0bc3fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:43:33.452 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.336+0000 7f98b0bc3fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:43:33.452 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.340+0000 7f98b0bc3fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:43:33.452 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.341+0000 7f98b0bc3fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:43:33.452 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 13 03:43:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-z[28481]: 2026-02-13T03:43:33.342+0000 7f98b0bc3fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:43:33.494 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T03:43:33.495 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:33.495 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-13T03:43:33.495 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:33.495 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:33.495 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-13 03:43:09.866560011 +0000 2026-02-13T03:43:33.495 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-13 03:41:34.695809382 +0000 2026-02-13T03:43:33.495 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-13 03:41:34.695809382 +0000 2026-02-13T03:43:33.495 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-13 03:41:34.695809382 +0000 2026-02-13T03:43:33.496 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T03:43:33.557 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-13T03:43:33.557 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-13T03:43:33.557 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000149248 s, 3.4 MB/s 2026-02-13T03:43:33.558 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T03:43:33.615 DEBUG:teuthology.orchestra.run.trial127:> set -ex 2026-02-13T03:43:33.615 DEBUG:teuthology.orchestra.run.trial127:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T03:43:33.630 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T03:43:33.630 DEBUG:teuthology.orchestra.run.trial127:> stat /dev/vg_nvme/lv_1 2026-02-13T03:43:33.671 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.410+0000 7fa65bd24fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:43:33.671 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.669+0000 7fa65bd24fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:43:33.686 INFO:teuthology.orchestra.run.trial127.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T03:43:33.686 INFO:teuthology.orchestra.run.trial127.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:33.686 INFO:teuthology.orchestra.run.trial127.stdout:Device: 6h/6d Inode: 1318 Links: 1 2026-02-13T03:43:33.686 INFO:teuthology.orchestra.run.trial127.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:33.686 INFO:teuthology.orchestra.run.trial127.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:33.686 INFO:teuthology.orchestra.run.trial127.stdout:Access: 2026-02-13 03:43:33.182506506 +0000 2026-02-13T03:43:33.686 INFO:teuthology.orchestra.run.trial127.stdout:Modify: 2026-02-13 03:41:33.703392693 +0000 2026-02-13T03:43:33.686 INFO:teuthology.orchestra.run.trial127.stdout:Change: 2026-02-13 03:41:33.703392693 +0000 2026-02-13T03:43:33.686 INFO:teuthology.orchestra.run.trial127.stdout: Birth: 2026-02-13 03:41:33.703392693 +0000 2026-02-13T03:43:33.687 DEBUG:teuthology.orchestra.run.trial127:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T03:43:33.753 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records in 2026-02-13T03:43:33.754 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records out 2026-02-13T03:43:33.754 INFO:teuthology.orchestra.run.trial127.stderr:512 bytes copied, 0.000162033 s, 3.2 MB/s 2026-02-13T03:43:33.755 DEBUG:teuthology.orchestra.run.trial127:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T03:43:33.814 DEBUG:teuthology.orchestra.run.trial127:> stat /dev/vg_nvme/lv_2 2026-02-13T03:43:33.869 INFO:teuthology.orchestra.run.trial127.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T03:43:33.869 INFO:teuthology.orchestra.run.trial127.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:33.869 INFO:teuthology.orchestra.run.trial127.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-13T03:43:33.869 INFO:teuthology.orchestra.run.trial127.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:33.869 INFO:teuthology.orchestra.run.trial127.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:33.869 INFO:teuthology.orchestra.run.trial127.stdout:Access: 2026-02-13 03:43:33.182506506 +0000 2026-02-13T03:43:33.869 INFO:teuthology.orchestra.run.trial127.stdout:Modify: 2026-02-13 03:41:33.701392727 +0000 2026-02-13T03:43:33.869 INFO:teuthology.orchestra.run.trial127.stdout:Change: 2026-02-13 03:41:33.701392727 +0000 2026-02-13T03:43:33.869 INFO:teuthology.orchestra.run.trial127.stdout: Birth: 2026-02-13 03:41:33.701392727 +0000 2026-02-13T03:43:33.870 DEBUG:teuthology.orchestra.run.trial127:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T03:43:33.933 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.679+0000 7fa65bd24fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:43:33.933 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.685+0000 7fa65bd24fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.692+0000 7fa65bd24fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.698+0000 7fa65bd24fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.710+0000 7fa65bd24fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.735+0000 7fa65bd24fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.738+0000 7fa65bd24fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.739+0000 7fa65bd24fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.746+0000 7fa65bd24fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.785+0000 7fa65bd24fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.787+0000 7fa65bd24fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.791+0000 7fa65bd24fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.793+0000 7fa65bd24fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.794+0000 7fa65bd24fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.797+0000 7fa65bd24fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.798+0000 7fa65bd24fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.801+0000 7fa65bd24fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:43:33.934 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.803+0000 7fa65bd24fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:43:33.936 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records in 2026-02-13T03:43:33.936 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records out 2026-02-13T03:43:33.936 INFO:teuthology.orchestra.run.trial127.stderr:512 bytes copied, 0.000164147 s, 3.1 MB/s 2026-02-13T03:43:33.937 DEBUG:teuthology.orchestra.run.trial127:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T03:43:33.996 DEBUG:teuthology.orchestra.run.trial127:> stat /dev/vg_nvme/lv_3 2026-02-13T03:43:34.052 INFO:teuthology.orchestra.run.trial127.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T03:43:34.052 INFO:teuthology.orchestra.run.trial127.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:34.052 INFO:teuthology.orchestra.run.trial127.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-13T03:43:34.052 INFO:teuthology.orchestra.run.trial127.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:34.053 INFO:teuthology.orchestra.run.trial127.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:34.053 INFO:teuthology.orchestra.run.trial127.stdout:Access: 2026-02-13 03:43:33.182506506 +0000 2026-02-13T03:43:34.053 INFO:teuthology.orchestra.run.trial127.stdout:Modify: 2026-02-13 03:41:33.702392710 +0000 2026-02-13T03:43:34.053 INFO:teuthology.orchestra.run.trial127.stdout:Change: 2026-02-13 03:41:33.702392710 +0000 2026-02-13T03:43:34.053 INFO:teuthology.orchestra.run.trial127.stdout: Birth: 2026-02-13 03:41:33.702392710 +0000 2026-02-13T03:43:34.053 DEBUG:teuthology.orchestra.run.trial127:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T03:43:34.116 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records in 2026-02-13T03:43:34.116 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records out 2026-02-13T03:43:34.116 INFO:teuthology.orchestra.run.trial127.stderr:512 bytes copied, 0.000162745 s, 3.1 MB/s 2026-02-13T03:43:34.117 DEBUG:teuthology.orchestra.run.trial127:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T03:43:34.174 DEBUG:teuthology.orchestra.run.trial127:> stat /dev/vg_nvme/lv_4 2026-02-13T03:43:34.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: Standby manager daemon z started 2026-02-13T03:43:34.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:34.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:34.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:34.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: Standby manager daemon z started 2026-02-13T03:43:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.985+0000 7fa65bd24fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.985+0000 7fa65bd24fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.988+0000 7fa65bd24fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.990+0000 7fa65bd24fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.992+0000 7fa65bd24fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.992+0000 7fa65bd24fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:33.992+0000 7fa65bd24fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:34.136+0000 7fa65bd24fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:43:34.224 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:34.164+0000 7fa65bd24fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:43:34.225 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:34.168+0000 7fa65bd24fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:43:34.225 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:34.169+0000 7fa65bd24fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:43:34.225 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:43:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y[27507]: 2026-02-13T03:43:34.170+0000 7fa65bd24fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:43:34.230 INFO:teuthology.orchestra.run.trial127.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T03:43:34.230 INFO:teuthology.orchestra.run.trial127.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:34.230 INFO:teuthology.orchestra.run.trial127.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-13T03:43:34.231 INFO:teuthology.orchestra.run.trial127.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:34.231 INFO:teuthology.orchestra.run.trial127.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:34.231 INFO:teuthology.orchestra.run.trial127.stdout:Access: 2026-02-13 03:43:33.183506489 +0000 2026-02-13T03:43:34.231 INFO:teuthology.orchestra.run.trial127.stdout:Modify: 2026-02-13 03:41:33.701392727 +0000 2026-02-13T03:43:34.231 INFO:teuthology.orchestra.run.trial127.stdout:Change: 2026-02-13 03:41:33.701392727 +0000 2026-02-13T03:43:34.231 INFO:teuthology.orchestra.run.trial127.stdout: Birth: 2026-02-13 03:41:33.701392727 +0000 2026-02-13T03:43:34.231 DEBUG:teuthology.orchestra.run.trial127:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T03:43:34.292 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records in 2026-02-13T03:43:34.292 INFO:teuthology.orchestra.run.trial127.stderr:1+0 records out 2026-02-13T03:43:34.292 INFO:teuthology.orchestra.run.trial127.stderr:512 bytes copied, 0.000159748 s, 3.2 MB/s 2026-02-13T03:43:34.294 DEBUG:teuthology.orchestra.run.trial127:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: Standby manager daemon z started 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:34.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:34.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:34.350 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-13T03:43:34.350 DEBUG:teuthology.orchestra.run.trial177:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T03:43:34.369 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T03:43:34.369 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_1 2026-02-13T03:43:34.426 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T03:43:34.426 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:34.426 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-13T03:43:34.426 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:34.426 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:34.426 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-13 03:43:32.376873484 +0000 2026-02-13T03:43:34.426 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-13 03:41:33.660415494 +0000 2026-02-13T03:43:34.426 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-13 03:41:33.660415494 +0000 2026-02-13T03:43:34.426 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-13 03:41:33.660415494 +0000 2026-02-13T03:43:34.426 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T03:43:34.492 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-13T03:43:34.492 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-13T03:43:34.492 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000193369 s, 2.6 MB/s 2026-02-13T03:43:34.493 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T03:43:34.550 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_2 2026-02-13T03:43:34.606 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T03:43:34.606 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:34.606 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-13T03:43:34.606 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:34.606 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:34.606 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-13 03:43:32.376873484 +0000 2026-02-13T03:43:34.606 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-13 03:41:33.659415511 +0000 2026-02-13T03:43:34.606 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-13 03:41:33.659415511 +0000 2026-02-13T03:43:34.606 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-13 03:41:33.659415511 +0000 2026-02-13T03:43:34.607 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T03:43:34.669 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-13T03:43:34.669 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-13T03:43:34.669 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000147033 s, 3.5 MB/s 2026-02-13T03:43:34.670 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T03:43:34.727 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_3 2026-02-13T03:43:34.783 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T03:43:34.783 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:34.783 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1322 Links: 1 2026-02-13T03:43:34.783 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:34.783 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:34.783 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-13 03:43:32.376873484 +0000 2026-02-13T03:43:34.783 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-13 03:41:33.661415477 +0000 2026-02-13T03:43:34.784 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-13 03:41:33.661415477 +0000 2026-02-13T03:43:34.784 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-13 03:41:33.661415477 +0000 2026-02-13T03:43:34.784 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T03:43:34.845 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-13T03:43:34.845 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-13T03:43:34.846 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000158244 s, 3.2 MB/s 2026-02-13T03:43:34.846 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T03:43:34.904 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_4 2026-02-13T03:43:34.961 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T03:43:34.961 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:43:34.961 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-13T03:43:34.961 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:43:34.961 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:43:34.962 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-13 03:43:32.376873484 +0000 2026-02-13T03:43:34.962 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-13 03:41:33.660415494 +0000 2026-02-13T03:43:34.962 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-13 03:41:33.660415494 +0000 2026-02-13T03:43:34.962 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-13 03:41:33.660415494 +0000 2026-02-13T03:43:34.962 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T03:43:35.023 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-13T03:43:35.023 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-13T03:43:35.023 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000154226 s, 3.3 MB/s 2026-02-13T03:43:35.024 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T03:43:35.081 INFO:tasks.cephadm:Deploying osd.0 on trial070 with /dev/vg_nvme/lv_4... 2026-02-13T03:43:35.081 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T03:43:35.201 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:35.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: mgrmap e9: x(active, since 31s), standbys: z 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: Standby manager daemon y started 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: mgrmap e9: x(active, since 31s), standbys: z 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: Standby manager daemon y started 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:35.270 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:35.271 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:35.271 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:35.271 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: mgrmap e9: x(active, since 31s), standbys: z 2026-02-13T03:43:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T03:43:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:43:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:43:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: Standby manager daemon y started 2026-02-13T03:43:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:35.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:35.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:35.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:35.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:35.637 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:35.655 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial070:vg_nvme/lv_4 --skip-validation 2026-02-13T03:43:35.775 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:35.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/1370888827 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a810eec0 msgr2=0x7fa8a810f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:35.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/1370888827 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a810eec0 0x7fa8a810f2b0 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=17271898032059911553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa894009970 tx=0x7fa89402ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:35.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/1370888827 shutdown_connections 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/1370888827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa8a81109f0 0x7fa8a8171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/1370888827 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8a8110040 0x7fa8a81104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/1370888827 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a810eec0 0x7fa8a810f2b0 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=17271898032059911553 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/1370888827 >> 10.20.193.70:0/1370888827 conn(0x7fa8a80ec5c0 msgr2=0x7fa8a810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/1370888827 shutdown_connections 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/1370888827 wait complete. 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 Processor -- start 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.893+0000 7fa8ae23d6c0 1 -- start start 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8ae23d6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa8a810eec0 0x7fa8a80f8650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8ae23d6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8a8110040 0x7fa8a8171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8ae23d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a81109f0 0x7fa8a80f8eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8ae23d6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a80f9ae0 con 0x7fa8a81109f0 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8ae23d6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a80f9c50 con 0x7fa8a8110040 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8ae23d6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a80f9e10 con 0x7fa8a810eec0 2026-02-13T03:43:35.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a7fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a81109f0 0x7fa8a80f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a7fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a81109f0 0x7fa8a80f8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:44072/0 (socket says 10.20.193.70:44072) 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a7fff6c0 1 -- 10.20.193.70:0/2663806702 learned_addr learned my addr 10.20.193.70:0/2663806702 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a77fe6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa8a810eec0 0x7fa8a80f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a7fff6c0 1 -- 10.20.193.70:0/2663806702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa8a810eec0 msgr2=0x7fa8a80f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a7fff6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa8a810eec0 0x7fa8a80f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a6ffd6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8a8110040 0x7fa8a8171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a7fff6c0 1 -- 10.20.193.70:0/2663806702 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8a8110040 msgr2=0x7fa8a8171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a7fff6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8a8110040 0x7fa8a8171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a7fff6c0 1 -- 10.20.193.70:0/2663806702 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa894009590 con 0x7fa8a81109f0 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a6ffd6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8a8110040 0x7fa8a8171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a7fff6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a81109f0 0x7fa8a80f8eb0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa89c006ea0 tx=0x7fa89c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a4ff96c0 1 -- 10.20.193.70:0/2663806702 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa89c003c40 con 0x7fa8a81109f0 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a4ff96c0 1 -- 10.20.193.70:0/2663806702 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa89c003da0 con 0x7fa8a81109f0 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a80fa0f0 con 0x7fa8a81109f0 2026-02-13T03:43:35.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8a4ff96c0 1 -- 10.20.193.70:0/2663806702 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa89c0081c0 con 0x7fa8a81109f0 2026-02-13T03:43:35.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a80fa5d0 con 0x7fa8a81109f0 2026-02-13T03:43:35.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.894+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a8175260 con 0x7fa8a81109f0 2026-02-13T03:43:35.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.896+0000 7fa8a4ff96c0 1 -- 10.20.193.70:0/2663806702 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 10) ==== 157010+0+0 (secure 0 0 0) 0x7fa89c005860 con 0x7fa8a81109f0 2026-02-13T03:43:35.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.897+0000 7fa8a4ff96c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa87c0b55f0 0x7fa87c0d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:35.900 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.897+0000 7fa8a77fe6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa87c0b55f0 0x7fa87c0d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:35.900 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.897+0000 7fa8a4ff96c0 1 -- 10.20.193.70:0/2663806702 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fa89c0e2e50 con 0x7fa8a81109f0 2026-02-13T03:43:35.900 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.897+0000 7fa8a77fe6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa87c0b55f0 0x7fa87c0d5aa0 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8940023e0 tx=0x7fa894005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:35.900 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.897+0000 7fa8a4ff96c0 1 -- 10.20.193.70:0/2663806702 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa89c0a7560 con 0x7fa8a81109f0 2026-02-13T03:43:35.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:35.995+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fa8a80f14f0 con 0x7fa87c0b55f0 2026-02-13T03:43:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: mgrmap e10: x(active, since 33s), standbys: z, y 2026-02-13T03:43:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T03:43:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: mgrmap e10: x(active, since 33s), standbys: z, y 2026-02-13T03:43:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T03:43:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: mgrmap e10: x(active, since 33s), standbys: z, y 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:37.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:37 trial070 ceph-mon[24757]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:37.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:37 trial070 ceph-mon[24757]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:37.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:37 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4011927964' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76aee801-8323-41e6-8540-7d0b5fa666e8"} : dispatch 2026-02-13T03:43:37.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:37 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4011927964' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76aee801-8323-41e6-8540-7d0b5fa666e8"}]': finished 2026-02-13T03:43:37.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:37 trial070 ceph-mon[24757]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T03:43:37.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:37.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:37 trial177 ceph-mon[27082]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:37.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:37 trial177 ceph-mon[27082]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:37.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:37 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4011927964' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76aee801-8323-41e6-8540-7d0b5fa666e8"} : dispatch 2026-02-13T03:43:37.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:37 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4011927964' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76aee801-8323-41e6-8540-7d0b5fa666e8"}]': finished 2026-02-13T03:43:37.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:37 trial177 ceph-mon[27082]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T03:43:37.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:37.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:37 trial127 ceph-mon[26439]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:37.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:37 trial127 ceph-mon[26439]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:37.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:37 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4011927964' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "76aee801-8323-41e6-8540-7d0b5fa666e8"} : dispatch 2026-02-13T03:43:37.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:37 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4011927964' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76aee801-8323-41e6-8540-7d0b5fa666e8"}]': finished 2026-02-13T03:43:37.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:37 trial127 ceph-mon[26439]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T03:43:37.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:38.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:38 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1278774344' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:38.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:38 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:38.374 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:38 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1278774344' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:38.374 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:38 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:38.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:38 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1278774344' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:38.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:38 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:39.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:39 trial070 ceph-mon[24757]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:39.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:39 trial177 ceph-mon[27082]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:39.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:39 trial127 ceph-mon[26439]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:40.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:40 trial070 ceph-mon[24757]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:40.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:40 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:40.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:40 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T03:43:40.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:40 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:40.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:40 trial177 ceph-mon[27082]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:40.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:40 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:40.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:40 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T03:43:40.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:40 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:40.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:40 trial127 ceph-mon[26439]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:40.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:40 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:40.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:40 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T03:43:40.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:40 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:42.190 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:42.191 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:42.191 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.191 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.191 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.191 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.191 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:42.191 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:42.191 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.192 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:42.192 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:42.192 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:42.333 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.331+0000 7fa8a4ff96c0 1 -- 10.20.193.70:0/2663806702 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fa8a80f14f0 con 0x7fa87c0b55f0 2026-02-13T03:43:42.334 INFO:teuthology.orchestra.run.trial070.stdout:Created osd(s) 0 on host 'trial070' 2026-02-13T03:43:42.336 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa87c0b55f0 msgr2=0x7fa87c0d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:42.336 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa87c0b55f0 0x7fa87c0d5aa0 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8940023e0 tx=0x7fa894005c00 comp rx=0 tx=0).stop 2026-02-13T03:43:42.336 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a81109f0 msgr2=0x7fa8a80f8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:42.336 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a81109f0 0x7fa8a80f8eb0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa89c006ea0 tx=0x7fa89c00ce50 comp rx=0 tx=0).stop 2026-02-13T03:43:42.336 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 shutdown_connections 2026-02-13T03:43:42.337 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa87c0b55f0 0x7fa87c0d5aa0 unknown :-1 s=CLOSED pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:42.337 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa8a81109f0 0x7fa8a80f8eb0 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:42.337 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa8a8110040 0x7fa8a8171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:42.337 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 --2- 10.20.193.70:0/2663806702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa8a810eec0 0x7fa8a80f8650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:42.337 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 >> 10.20.193.70:0/2663806702 conn(0x7fa8a80ec5c0 msgr2=0x7fa8a80eebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:42.337 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 shutdown_connections 2026-02-13T03:43:42.337 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:42.334+0000 7fa8ae23d6c0 1 -- 10.20.193.70:0/2663806702 wait complete. 2026-02-13T03:43:42.378 DEBUG:teuthology.orchestra.run.trial070:osd.0> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.0.service 2026-02-13T03:43:42.380 INFO:tasks.cephadm:Deploying osd.1 on trial127 with /dev/vg_nvme/lv_4... 2026-02-13T03:43:42.380 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T03:43:42.404 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:42.404 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:42.405 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:42.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:42.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:42.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:42.497 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.b/config 2026-02-13T03:43:42.912 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:43:42.929 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial127:vg_nvme/lv_4 --skip-validation 2026-02-13T03:43:43.087 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.b/config 2026-02-13T03:43:43.201 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2419101 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110050 msgr2=0x7ff3e41104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:43.201 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2419101 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110050 0x7ff3e41104c0 secure :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=14772157255251709146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3d4009970 tx=0x7ff3d402ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:43.201 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2419101 shutdown_connections 2026-02-13T03:43:43.201 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2419101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff3e4110a00 0x7ff3e4171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:43.201 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2419101 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110050 0x7ff3e41104c0 unknown :-1 s=CLOSED pgs=5 gs=1 cs=0 l=1 c_cookie=14772157255251709146 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:43.202 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2419101 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff3e410eed0 0x7ff3e410f2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:43.202 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2419101 >> 10.20.193.127:0/2419101 conn(0x7ff3e40ec5f0 msgr2=0x7ff3e410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:43.202 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2419101 shutdown_connections 2026-02-13T03:43:43.202 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2419101 wait complete. 2026-02-13T03:43:43.202 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:43 trial127 ceph-mon[26439]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:43.202 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:43 trial127 ceph-mon[26439]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:43:43.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:43 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:43.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:43 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:43.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:43 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:43.205 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 Processor -- start 2026-02-13T03:43:43.205 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 -- start start 2026-02-13T03:43:43.205 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff3e410eed0 0x7ff3e40f8680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff3e4110050 0x7ff3e4171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110a00 0x7ff3e40f8ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40f9b10 con 0x7ff3e4110050 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40f9c80 con 0x7ff3e4110a00 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3ea0f86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40f9e40 con 0x7ff3e410eed0 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e3fff6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110a00 0x7ff3e40f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e3fff6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110a00 0x7ff3e40f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.127:53042/0 (socket says 10.20.193.127:53042) 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e3fff6c0 1 -- 10.20.193.127:0/2221516238 learned_addr learned my addr 10.20.193.127:0/2221516238 (peer_addr_for_me v2:10.20.193.127:0/0) 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e2ffd6c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff3e4110050 0x7ff3e4171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e37fe6c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff3e410eed0 0x7ff3e40f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:43.206 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e3fff6c0 1 -- 10.20.193.127:0/2221516238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff3e410eed0 msgr2=0x7ff3e40f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e3fff6c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff3e410eed0 0x7ff3e40f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e3fff6c0 1 -- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff3e4110050 msgr2=0x7ff3e4171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e3fff6c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff3e4110050 0x7ff3e4171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.200+0000 7ff3e3fff6c0 1 -- 10.20.193.127:0/2221516238 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d4009590 con 0x7ff3e4110a00 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.201+0000 7ff3e3fff6c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110a00 0x7ff3e40f8ee0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3d8006ea0 tx=0x7ff3d800cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.201+0000 7ff3e0ff96c0 1 -- 10.20.193.127:0/2221516238 <== mon.2 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3d8003a30 con 0x7ff3e4110a00 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.201+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e40fa120 con 0x7ff3e4110a00 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.201+0000 7ff3e0ff96c0 1 -- 10.20.193.127:0/2221516238 <== mon.2 v2:10.20.193.127:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff3d80054f0 con 0x7ff3e4110a00 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.201+0000 7ff3e0ff96c0 1 -- 10.20.193.127:0/2221516238 <== mon.2 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff3d800dcd0 con 0x7ff3e4110a00 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.201+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e40fa600 con 0x7ff3e4110a00 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.201+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e41752f0 con 0x7ff3e4110a00 2026-02-13T03:43:43.207 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.202+0000 7ff3e0ff96c0 1 -- 10.20.193.127:0/2221516238 <== mon.2 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 10) ==== 157010+0+0 (secure 0 0 0) 0x7ff3d8005030 con 0x7ff3e4110a00 2026-02-13T03:43:43.208 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.203+0000 7ff3e0ff96c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff3b80b5570 0x7ff3b80d5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:43.208 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.203+0000 7ff3e37fe6c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff3b80b5570 0x7ff3b80d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:43.208 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.203+0000 7ff3e0ff96c0 1 -- 10.20.193.127:0/2221516238 <== mon.2 v2:10.20.193.127:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1141+0+0 (secure 0 0 0) 0x7ff3d80e2f80 con 0x7ff3e4110a00 2026-02-13T03:43:43.208 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.203+0000 7ff3e37fe6c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff3b80b5570 0x7ff3b80d5a20 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3d0006b60 tx=0x7ff3d0006af0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:43.208 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.204+0000 7ff3e0ff96c0 1 -- 10.20.193.127:0/2221516238 <== mon.2 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff3d80a75c0 con 0x7ff3e4110a00 2026-02-13T03:43:43.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:43 trial070 ceph-mon[24757]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:43.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:43 trial070 ceph-mon[24757]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:43:43.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:43 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:43.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:43 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:43.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:43 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:43.302 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:43.301+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7ff3e404ca20 con 0x7ff3b80b5570 2026-02-13T03:43:43.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:43 trial177 ceph-mon[27082]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:43.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:43 trial177 ceph-mon[27082]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:43:43.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:43 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:43.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:43 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:43.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:43 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:44.198 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:44.198 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T03:43:44.198 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T03:43:44.198 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:44.198 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:44.199 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.200 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:44.200 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:44.200 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:44.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:44.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:44.301 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:43:44 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0[37197]: 2026-02-13T03:43:44.037+0000 7ff179a976c0 -1 osd.0 0 waiting for initial osdmap 2026-02-13T03:43:44.301 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:43:44 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0[37197]: 2026-02-13T03:43:44.039+0000 7ff17595b6c0 -1 osd.0 6 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:43:44.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:44.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:44.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:44.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:44.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:44.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:44.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:44.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:45.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:45.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "621ea3ce-4cd8-4150-a1ba-f4e189f680bd"} : dispatch 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "621ea3ce-4cd8-4150-a1ba-f4e189f680bd"}]': finished 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='client.? 10.20.193.127:0/431807796' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "621ea3ce-4cd8-4150-a1ba-f4e189f680bd"} : dispatch 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] boot 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:45.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:45.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: from='client.? 10.20.193.127:0/266716393' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:45.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:45.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:45 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:43:45.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "621ea3ce-4cd8-4150-a1ba-f4e189f680bd"} : dispatch 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "621ea3ce-4cd8-4150-a1ba-f4e189f680bd"}]': finished 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='client.? 10.20.193.127:0/431807796' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "621ea3ce-4cd8-4150-a1ba-f4e189f680bd"} : dispatch 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] boot 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T03:43:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:45.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:45.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: from='client.? 10.20.193.127:0/266716393' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:45.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:45.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:45 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:43:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:43:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:43:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T03:43:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "621ea3ce-4cd8-4150-a1ba-f4e189f680bd"} : dispatch 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "621ea3ce-4cd8-4150-a1ba-f4e189f680bd"}]': finished 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='client.? 10.20.193.127:0/431807796' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "621ea3ce-4cd8-4150-a1ba-f4e189f680bd"} : dispatch 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: osd.0 [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] boot 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: from='client.? 10.20.193.127:0/266716393' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:45 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:46.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:46.323 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:46.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:43:46.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:43:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:47.177 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:47 trial127 ceph-mon[26439]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:47.177 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:47 trial127 ceph-mon[26439]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:47.178 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:47 trial127 ceph-mon[26439]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:47.178 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:47 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T03:43:47.178 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:47 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:47.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:47 trial070 ceph-mon[24757]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:47.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:47 trial070 ceph-mon[24757]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:47.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:47 trial070 ceph-mon[24757]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:47.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:47 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T03:43:47.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:47 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:47.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:47 trial177 ceph-mon[27082]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:47.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:47 trial177 ceph-mon[27082]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:47.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:47 trial177 ceph-mon[27082]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:47.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:47 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T03:43:47.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:47 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:48.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:48 trial070 ceph-mon[24757]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:48.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:48 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:48.321 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:48 trial127 ceph-mon[26439]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:48.321 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:48 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:48.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:48 trial177 ceph-mon[27082]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:48.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:48 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:49.080 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:49.080 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:49.080 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:49.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:49.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:49.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:49.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:49.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:49.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:49.577 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.577+0000 7ff3e0ff96c0 1 -- 10.20.193.127:0/2221516238 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7ff3e404ca20 con 0x7ff3b80b5570 2026-02-13T03:43:49.578 INFO:teuthology.orchestra.run.trial127.stdout:Created osd(s) 1 on host 'trial127' 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff3b80b5570 msgr2=0x7ff3b80d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff3b80b5570 0x7ff3b80d5a20 secure :-1 s=READY pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3d0006b60 tx=0x7ff3d0006af0 comp rx=0 tx=0).stop 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110a00 msgr2=0x7ff3e40f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110a00 0x7ff3e40f8ee0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3d8006ea0 tx=0x7ff3d800cca0 comp rx=0 tx=0).stop 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 shutdown_connections 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff3b80b5570 0x7ff3b80d5a20 unknown :-1 s=CLOSED pgs=82 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff3e4110a00 0x7ff3e40f8ee0 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff3e4110050 0x7ff3e4171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 --2- 10.20.193.127:0/2221516238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff3e410eed0 0x7ff3e40f8680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 >> 10.20.193.127:0/2221516238 conn(0x7ff3e40ec5f0 msgr2=0x7ff3e40eec10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 shutdown_connections 2026-02-13T03:43:49.580 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:43:49.579+0000 7ff3ea0f86c0 1 -- 10.20.193.127:0/2221516238 wait complete. 2026-02-13T03:43:49.620 DEBUG:teuthology.orchestra.run.trial127:osd.1> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.1.service 2026-02-13T03:43:49.622 INFO:tasks.cephadm:Deploying osd.2 on trial177 with /dev/vg_nvme/lv_4... 2026-02-13T03:43:49.622 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T03:43:49.740 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:43:50.164 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:43:50.182 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial177:vg_nvme/lv_4 --skip-validation 2026-02-13T03:43:50.299 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:43:50.412 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:50.412 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.412 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.412 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:50.412 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='osd.1 [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:50.413 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:43:50.414 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:50.414 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 -- 10.20.193.177:0/2500176337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc150c90 msgr2=0x7fd0fc171070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:50.414 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2500176337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc150c90 0x7fd0fc171070 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=17609264675255668395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f800aa40 tx=0x7fd0f802fde0 comp rx=0 tx=0).stop 2026-02-13T03:43:50.415 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 -- 10.20.193.177:0/2500176337 shutdown_connections 2026-02-13T03:43:50.415 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2500176337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc150c90 0x7fd0fc171070 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=17609264675255668395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:50.415 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2500176337 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0fc060d80 0x7fd0fc0611f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:50.415 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2500176337 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd0fc0621c0 0x7fd0fc060840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:50.415 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 -- 10.20.193.177:0/2500176337 >> 10.20.193.177:0/2500176337 conn(0x7fd0fc0ea360 msgr2=0x7fd0fc10a770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:50.415 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 -- 10.20.193.177:0/2500176337 shutdown_connections 2026-02-13T03:43:50.415 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 -- 10.20.193.177:0/2500176337 wait complete. 2026-02-13T03:43:50.415 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:43:50.416 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='osd.1 [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:43:50.417 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.417 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.417 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:50.417 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:43:50.417 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:50.419 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 Processor -- start 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 -- start start 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd0fc060d80 0x7fd0fc15c5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc0621c0 0x7fd0fc15cc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0fc150c90 0x7fd0fc15d800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc15df90 con 0x7fd0fc060d80 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc15e100 con 0x7fd0fc150c90 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1033086c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc15e2c0 con 0x7fd0fc0621c0 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1008786c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc0621c0 0x7fd0fc15cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1008786c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc0621c0 0x7fd0fc15cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:55264/0 (socket says 10.20.193.177:55264) 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1008786c0 1 -- 10.20.193.177:0/2425907139 learned_addr learned my addr 10.20.193.177:0/2425907139 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-13T03:43:50.420 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.410+0000 7fd1010796c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd0fc060d80 0x7fd0fc15c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd10187a6c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0fc150c90 0x7fd0fc15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd1008786c0 1 -- 10.20.193.177:0/2425907139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0fc150c90 msgr2=0x7fd0fc15d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd1008786c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0fc150c90 0x7fd0fc15d800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd1008786c0 1 -- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd0fc060d80 msgr2=0x7fd0fc15c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd1008786c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd0fc060d80 0x7fd0fc15c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd1008786c0 1 -- 10.20.193.177:0/2425907139 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f800a660 con 0x7fd0fc0621c0 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd1008786c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc0621c0 0x7fd0fc15cc10 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f000b6c0 tx=0x7fd0f000bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd0ea7fc6c0 1 -- 10.20.193.177:0/2425907139 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0f00044a0 con 0x7fd0fc0621c0 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc15e5a0 con 0x7fd0fc0621c0 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd0ea7fc6c0 1 -- 10.20.193.177:0/2425907139 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd0f000be50 con 0x7fd0fc0621c0 2026-02-13T03:43:50.421 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd0ea7fc6c0 1 -- 10.20.193.177:0/2425907139 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0f000cd00 con 0x7fd0fc0621c0 2026-02-13T03:43:50.422 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc15eae0 con 0x7fd0fc0621c0 2026-02-13T03:43:50.422 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.411+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0fc1752d0 con 0x7fd0fc0621c0 2026-02-13T03:43:50.422 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.413+0000 7fd0ea7fc6c0 1 -- 10.20.193.177:0/2425907139 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 10) ==== 157010+0+0 (secure 0 0 0) 0x7fd0f00026b0 con 0x7fd0fc0621c0 2026-02-13T03:43:50.422 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.413+0000 7fd0ea7fc6c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0d80b5570 0x7fd0d80d5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:50.422 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.413+0000 7fd0ea7fc6c0 1 -- 10.20.193.177:0/2425907139 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1681+0+0 (secure 0 0 0) 0x7fd0f00e1f20 con 0x7fd0fc0621c0 2026-02-13T03:43:50.422 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.414+0000 7fd1010796c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0d80b5570 0x7fd0d80d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:50.422 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.414+0000 7fd1010796c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0d80b5570 0x7fd0d80d5a20 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec004750 tx=0x7fd0ec009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:50.422 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.414+0000 7fd0ea7fc6c0 1 -- 10.20.193.177:0/2425907139 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd0f00a6410 con 0x7fd0fc0621c0 2026-02-13T03:43:50.512 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:50.509+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fd0fc04ca20 con 0x7fd0d80b5570 2026-02-13T03:43:50.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:50.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:50.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:50.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:50.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:50.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:50.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:50.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:43:50.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='osd.1 [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:43:50.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:50.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:50.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:43:50.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:51.417 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:51.418 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T03:43:51.418 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T03:43:51.418 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:51.418 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:43:51.418 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='osd.1 [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:43:51.418 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.418 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.418 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:51.418 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:51.419 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:51 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:51.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='osd.1 [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:51 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:51.476 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:43:51 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1[31266]: 2026-02-13T03:43:51.155+0000 7f9d5ac896c0 -1 osd.1 0 waiting for initial osdmap 2026-02-13T03:43:51.476 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:43:51 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1[31266]: 2026-02-13T03:43:51.158+0000 7f9d52b456c0 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='osd.1 [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:51.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:51 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/718453538' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c"} : dispatch 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c"} : dispatch 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c"}]': finished 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: osd.1 [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] boot 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: osdmap e10: 3 total, 2 up, 3 in 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/1110697690' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:52.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:52 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='client.? 10.20.193.177:0/718453538' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c"} : dispatch 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c"} : dispatch 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c"}]': finished 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: osd.1 [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] boot 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: osdmap e10: 3 total, 2 up, 3 in 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: from='client.? 10.20.193.177:0/1110697690' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:52 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/718453538' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c"} : dispatch 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c"} : dispatch 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c"}]': finished 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: osd.1 [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] boot 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: osdmap e10: 3 total, 2 up, 3 in 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:43:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:52.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/1110697690' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:52.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:52.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:52 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:43:53.310 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:53 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:43:53.310 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:53 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:43:53.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:53 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:43:53.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:53 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:43:53.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:53 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:43:53.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:53 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T03:43:54.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:54 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T03:43:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:54 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: pgmap v33: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T03:43:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:54 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:55.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:55 trial177 ceph-mon[27082]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:55.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:55 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:55.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:55 trial127 ceph-mon[26439]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:55.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:55 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:55.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:55 trial070 ceph-mon[24757]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:55.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:55 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:56.281 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:56.281 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:56.282 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:56.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:56.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:56.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:56.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:56.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:56.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:56.815 INFO:teuthology.orchestra.run.trial177.stdout:Created osd(s) 2 on host 'trial177' 2026-02-13T03:43:56.816 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.813+0000 7fd0ea7fc6c0 1 -- 10.20.193.177:0/2425907139 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fd0fc04ca20 con 0x7fd0d80b5570 2026-02-13T03:43:56.818 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0d80b5570 msgr2=0x7fd0d80d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:56.818 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0d80b5570 0x7fd0d80d5a20 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0ec004750 tx=0x7fd0ec009260 comp rx=0 tx=0).stop 2026-02-13T03:43:56.818 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc0621c0 msgr2=0x7fd0fc15cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:56.818 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc0621c0 0x7fd0fc15cc10 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f000b6c0 tx=0x7fd0f000bb90 comp rx=0 tx=0).stop 2026-02-13T03:43:56.819 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 shutdown_connections 2026-02-13T03:43:56.819 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0d80b5570 0x7fd0d80d5a20 unknown :-1 s=CLOSED pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:56.819 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd0fc150c90 0x7fd0fc15d800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:56.819 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd0fc0621c0 0x7fd0fc15cc10 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:56.819 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 --2- 10.20.193.177:0/2425907139 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd0fc060d80 0x7fd0fc15c5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:56.819 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 >> 10.20.193.177:0/2425907139 conn(0x7fd0fc0ea360 msgr2=0x7fd0fc10a740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:56.819 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 shutdown_connections 2026-02-13T03:43:56.819 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:43:56.815+0000 7fd1033086c0 1 -- 10.20.193.177:0/2425907139 wait complete. 2026-02-13T03:43:56.858 DEBUG:teuthology.orchestra.run.trial177:osd.2> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.2.service 2026-02-13T03:43:56.860 INFO:tasks.cephadm:Deploying osd.3 on trial070 with /dev/vg_nvme/lv_3... 2026-02-13T03:43:56.860 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T03:43:56.982 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:57.396 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:57.396 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.396 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.396 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='osd.2 [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.397 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:57.444 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:43:57.448 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:57.448 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.448 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.448 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:57.448 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='osd.2 [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.449 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:57.463 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial070:vg_nvme/lv_3 --skip-validation 2026-02-13T03:43:57.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:57.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='osd.2 [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:43:57.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:57.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:43:57.580 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:43:57.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.701+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/2259133870 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 msgr2=0x7f1c1810f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:57.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.701+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/2259133870 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 0x7f1c1810f2b0 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=5144887918085287613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c0c009970 tx=0x7f1c0c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:43:57.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.701+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/2259133870 shutdown_connections 2026-02-13T03:43:57.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.701+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/2259133870 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c181109f0 0x7f1c18171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:57.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.701+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/2259133870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c18110040 0x7f1c181104b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:57.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.701+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/2259133870 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 0x7f1c1810f2b0 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=5144887918085287613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:57.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.701+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/2259133870 >> 10.20.193.70:0/2259133870 conn(0x7f1c180ec5c0 msgr2=0x7f1c1810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.701+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/2259133870 shutdown_connections 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.701+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/2259133870 wait complete. 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 Processor -- start 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 -- start start 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 0x7f1c180f8660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c18110040 0x7f1c18171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c181109f0 0x7f1c180f8ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c180f9af0 con 0x7f1c1810eec0 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1c180f9c60 con 0x7f1c18110040 2026-02-13T03:43:57.707 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1c180f9e20 con 0x7f1c181109f0 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c16ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 0x7f1c180f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c16ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 0x7f1c180f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:50254/0 (socket says 10.20.193.70:50254) 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c16ffd6c0 1 -- 10.20.193.70:0/979781571 learned_addr learned my addr 10.20.193.70:0/979781571 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c167fc6c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c18110040 0x7f1c18171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c16ffd6c0 1 -- 10.20.193.70:0/979781571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c181109f0 msgr2=0x7f1c180f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c16ffd6c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c181109f0 0x7f1c180f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c16ffd6c0 1 -- 10.20.193.70:0/979781571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c18110040 msgr2=0x7f1c18171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c16ffd6c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c18110040 0x7f1c18171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c16ffd6c0 1 -- 10.20.193.70:0/979781571 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c009590 con 0x7f1c1810eec0 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c16ffd6c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 0x7f1c180f8660 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c0c0092b0 tx=0x7f1c0c004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1bf7fff6c0 1 -- 10.20.193.70:0/979781571 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c0c002ba0 con 0x7f1c1810eec0 2026-02-13T03:43:57.708 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1bf7fff6c0 1 -- 10.20.193.70:0/979781571 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1c0c002d00 con 0x7f1c1810eec0 2026-02-13T03:43:57.709 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1bf7fff6c0 1 -- 10.20.193.70:0/979781571 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c0c0372f0 con 0x7f1c1810eec0 2026-02-13T03:43:57.709 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c180fa0a0 con 0x7f1c1810eec0 2026-02-13T03:43:57.709 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.702+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c180fa4d0 con 0x7f1c1810eec0 2026-02-13T03:43:57.709 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.703+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c180fa6f0 con 0x7f1c1810eec0 2026-02-13T03:43:57.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.704+0000 7f1bf7fff6c0 1 -- 10.20.193.70:0/979781571 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 10) ==== 157010+0+0 (secure 0 0 0) 0x7f1c0c0079a0 con 0x7f1c1810eec0 2026-02-13T03:43:57.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.705+0000 7f1bf7fff6c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1bec0b5570 0x7f1bec0d5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:43:57.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.705+0000 7f1c167fc6c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1bec0b5570 0x7f1bec0d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:43:57.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.705+0000 7f1bf7fff6c0 1 -- 10.20.193.70:0/979781571 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2221+0+0 (secure 0 0 0) 0x7f1c0c1065b0 con 0x7f1c1810eec0 2026-02-13T03:43:57.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.705+0000 7f1c167fc6c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1bec0b5570 0x7f1bec0d5a20 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c00006b60 tx=0x7f1c00006af0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:43:57.710 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.705+0000 7f1bf7fff6c0 1 -- 10.20.193.70:0/979781571 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1c0c0ce220 con 0x7f1c1810eec0 2026-02-13T03:43:57.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:43:57.803+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f1c180ef290 con 0x7f1bec0b5570 2026-02-13T03:43:58.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:58.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:58.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T03:43:58.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T03:43:58.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:58.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='osd.2 [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:43:58.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:58.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:58.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:58.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:58.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:58.466 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:58.466 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:58.466 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='osd.2 [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:58.467 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:58.468 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:58.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:58.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='osd.2 [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:58.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:43:58.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:43:58.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:43:58 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2[32309]: 2026-02-13T03:43:58.353+0000 7fd2111956c0 -1 osd.2 0 waiting for initial osdmap 2026-02-13T03:43:58.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:43:58 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2[32309]: 2026-02-13T03:43:58.356+0000 7fd20d0596c0 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:43:59.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:59.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:59.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:43:59.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1988787180' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "31edcb70-f683-4525-b2c3-348788484124"} : dispatch 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1988787180' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31edcb70-f683-4525-b2c3-348788484124"}]': finished 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: osd.2 [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] boot 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: osdmap e13: 4 total, 3 up, 4 in 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3894003270' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:59.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:43:59 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1988787180' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "31edcb70-f683-4525-b2c3-348788484124"} : dispatch 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1988787180' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31edcb70-f683-4525-b2c3-348788484124"}]': finished 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: osd.2 [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] boot 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: osdmap e13: 4 total, 3 up, 4 in 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:43:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3894003270' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:59.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:59.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:43:59 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:43:59.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:43:59.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:43:59.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1988787180' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "31edcb70-f683-4525-b2c3-348788484124"} : dispatch 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1988787180' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31edcb70-f683-4525-b2c3-348788484124"}]': finished 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: osd.2 [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] boot 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: osdmap e13: 4 total, 3 up, 4 in 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3894003270' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:43:59.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:43:59 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: osdmap e14: 4 total, 3 up, 4 in 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: pgmap v45: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:00.673 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:00.674 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:00.674 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:00.674 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:00.674 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:00.674 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:00.674 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:00.901 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34408]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T03:44:00.902 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34408]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.902 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.902 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34408]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:00.902 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34412]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T03:44:00.902 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34412]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.902 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.902 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34412]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:00.903 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:44:00.903 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:44:00.903 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T03:44:00.903 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: osdmap e14: 4 total, 3 up, 4 in 2026-02-13T03:44:00.903 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:00.903 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:44:00.903 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: pgmap v45: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:00.903 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:00.904 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:00.904 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:00.904 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:00.904 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:00.904 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:00.904 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:00.904 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:00.904 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:00.904 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34416]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T03:44:00.926 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42616]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T03:44:00.926 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42616]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.926 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.926 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42616]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:00.926 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42620]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T03:44:00.926 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42620]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.927 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.927 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42620]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:00.927 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42601]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T03:44:00.927 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42601]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.927 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.927 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42601]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:00.927 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42608]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T03:44:00.927 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42608]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.928 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.928 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:44:00 trial070 sudo[42608]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:00.951 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35288]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T03:44:00.952 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35288]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.952 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.952 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35288]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:00.952 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35292]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T03:44:00.952 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35292]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.952 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.952 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35292]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: osdmap e14: 4 total, 3 up, 4 in 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: pgmap v45: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35296]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35296]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35296]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35300]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T03:44:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35300]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:00 trial177 sudo[35300]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:01.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34416]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:01.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:01.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34416]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:01.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34420]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T03:44:01.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34420]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:44:01.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:44:01.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:00 trial127 sudo[34420]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:44:01.786 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: pgmap v46: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:01.786 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:01.786 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:44:01.786 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: osdmap e15: 4 total, 3 up, 4 in 2026-02-13T03:44:01.786 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:01.786 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.787 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:01 trial070 ceph-mon[24757]: pgmap v49: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:01.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: pgmap v46: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: osdmap e15: 4 total, 3 up, 4 in 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:44:01.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:01 trial177 ceph-mon[27082]: pgmap v49: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:01.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: pgmap v46: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: osdmap e15: 4 total, 3 up, 4 in 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:44:01.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:44:01.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:01.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:01 trial127 ceph-mon[26439]: pgmap v49: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:02.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:02 trial070 ceph-mon[24757]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T03:44:02.942 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:02.943 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:02 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:02.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:02.938+0000 7f1bf7fff6c0 1 -- 10.20.193.70:0/979781571 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f1c0c1046c0 con 0x7f1c1810eec0 2026-02-13T03:44:02.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:02 trial177 ceph-mon[27082]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T03:44:02.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:02.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:02 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:02.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:02 trial127 ceph-mon[26439]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T03:44:02.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:02.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:02 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:04.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: mgrmap e11: x(active, since 60s), standbys: z, y 2026-02-13T03:44:04.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:04.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:04.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:04.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:04.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:04.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:04.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:04.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: mgrmap e11: x(active, since 60s), standbys: z, y 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:04.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:04.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:04.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: mgrmap e11: x(active, since 60s), standbys: z, y 2026-02-13T03:44:04.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:04.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:04.305 INFO:teuthology.orchestra.run.trial070.stdout:Created osd(s) 3 on host 'trial070' 2026-02-13T03:44:04.305 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.303+0000 7f1bf7fff6c0 1 -- 10.20.193.70:0/979781571 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f1c180ef290 con 0x7f1bec0b5570 2026-02-13T03:44:04.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1bec0b5570 msgr2=0x7f1bec0d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:04.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1bec0b5570 0x7f1bec0d5a20 secure :-1 s=READY pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c00006b60 tx=0x7f1c00006af0 comp rx=0 tx=0).stop 2026-02-13T03:44:04.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 msgr2=0x7f1c180f8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:04.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 0x7f1c180f8660 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c0c0092b0 tx=0x7f1c0c004660 comp rx=0 tx=0).stop 2026-02-13T03:44:04.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 shutdown_connections 2026-02-13T03:44:04.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1bec0b5570 0x7f1bec0d5a20 unknown :-1 s=CLOSED pgs=92 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:04.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c181109f0 0x7f1c180f8ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:04.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1c18110040 0x7f1c18171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:04.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 --2- 10.20.193.70:0/979781571 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1c1810eec0 0x7f1c180f8660 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:04.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 >> 10.20.193.70:0/979781571 conn(0x7f1c180ec5c0 msgr2=0x7f1c180eeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:04.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 shutdown_connections 2026-02-13T03:44:04.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:04.305+0000 7f1c1d2c16c0 1 -- 10.20.193.70:0/979781571 wait complete. 2026-02-13T03:44:04.350 DEBUG:teuthology.orchestra.run.trial070:osd.3> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.3.service 2026-02-13T03:44:04.353 INFO:tasks.cephadm:Deploying osd.4 on trial127 with /dev/vg_nvme/lv_3... 2026-02-13T03:44:04.353 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T03:44:04.474 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.b/config 2026-02-13T03:44:04.893 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:44:04.911 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial127:vg_nvme/lv_3 --skip-validation 2026-02-13T03:44:05.028 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.b/config 2026-02-13T03:44:05.143 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:04 trial127 ceph-mon[26439]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:05.143 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:04 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:05.143 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:04 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:05.143 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:04 trial127 ceph-mon[26439]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T03:44:05.143 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:05.144 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:05.144 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:05.148 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 -- 10.20.193.127:0/1867335048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 msgr2=0x7fddf410cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:05.148 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/1867335048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 0x7fddf410cf20 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=17852265529267366376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddf000aa40 tx=0x7fddf002fde0 comp rx=0 tx=0).stop 2026-02-13T03:44:05.148 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 -- 10.20.193.127:0/1867335048 shutdown_connections 2026-02-13T03:44:05.148 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/1867335048 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 0x7fddf410cf20 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=17852265529267366376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/1867335048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fddf410b8b0 0x7fddf410bd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/1867335048 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fddf410ae80 0x7fddf410b270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 -- 10.20.193.127:0/1867335048 >> 10.20.193.127:0/1867335048 conn(0x7fddf40e8990 msgr2=0x7fddf4108da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 -- 10.20.193.127:0/1867335048 shutdown_connections 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 -- 10.20.193.127:0/1867335048 wait complete. 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 Processor -- start 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 -- start start 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fddf410ae80 0x7fddf40f3760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fddf410b8b0 0x7fddf40f3db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:05.149 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 0x7fddf40f49a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fddf40f5130 con 0x7fddf410b8b0 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fddf40f52a0 con 0x7fddf410c460 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.144+0000 7fddfb1236c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fddf40f5460 con 0x7fddf410ae80 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf96956c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 0x7fddf40f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf96956c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 0x7fddf40f49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.127:57758/0 (socket says 10.20.193.127:57758) 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf96956c0 1 -- 10.20.193.127:0/2316935558 learned_addr learned my addr 10.20.193.127:0/2316935558 (peer_addr_for_me v2:10.20.193.127:0/0) 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf8e946c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fddf410ae80 0x7fddf40f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddebfff6c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fddf410b8b0 0x7fddf40f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf96956c0 1 -- 10.20.193.127:0/2316935558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fddf410ae80 msgr2=0x7fddf40f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf96956c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fddf410ae80 0x7fddf40f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:05.150 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf96956c0 1 -- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fddf410b8b0 msgr2=0x7fddf40f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf96956c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fddf410b8b0 0x7fddf40f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf96956c0 1 -- 10.20.193.127:0/2316935558 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf000a660 con 0x7fddf410c460 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf8e946c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fddf410ae80 0x7fddf40f3760 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddf96956c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 0x7fddf40f49a0 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddf000a390 tx=0x7fddf0005670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fdde9ffb6c0 1 -- 10.20.193.127:0/2316935558 <== mon.2 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddf0003c40 con 0x7fddf410c460 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fdde9ffb6c0 1 -- 10.20.193.127:0/2316935558 <== mon.2 v2:10.20.193.127:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fddf0003da0 con 0x7fddf410c460 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf40f56e0 con 0x7fddf410c460 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fdde9ffb6c0 1 -- 10.20.193.127:0/2316935558 <== mon.2 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddf0038520 con 0x7fddf410c460 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf40f5bc0 con 0x7fddf410c460 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.145+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf4110d30 con 0x7fddf410c460 2026-02-13T03:44:05.151 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.146+0000 7fdde9ffb6c0 1 -- 10.20.193.127:0/2316935558 <== mon.2 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fddf00386f0 con 0x7fddf410c460 2026-02-13T03:44:05.152 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.147+0000 7fdde9ffb6c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fddd00b5680 0x7fddd00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:05.153 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.147+0000 7fdde9ffb6c0 1 -- 10.20.193.127:0/2316935558 <== mon.2 v2:10.20.193.127:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3129+0+0 (secure 0 0 0) 0x7fddf0107c60 con 0x7fddf410c460 2026-02-13T03:44:05.153 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.147+0000 7fddf8e946c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fddd00b5680 0x7fddd00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:05.153 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.148+0000 7fddf8e946c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fddd00b5680 0x7fddd00d5b30 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdde4004750 tx=0x7fdde4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:05.153 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.148+0000 7fdde9ffb6c0 1 -- 10.20.193.127:0/2316935558 <== mon.2 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fddf00cba00 con 0x7fddf410c460 2026-02-13T03:44:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:04 trial177 ceph-mon[27082]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:04 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:04 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:04 trial177 ceph-mon[27082]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T03:44:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:05.249 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:05.247+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fddf404ca20 con 0x7fddd00b5680 2026-02-13T03:44:05.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:04 trial070 ceph-mon[24757]: pgmap v52: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:05.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:04 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:05.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:04 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:05.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:04 trial070 ceph-mon[24757]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T03:44:05.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:05.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:05.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:06.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='client.24194 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='client.? 10.20.193.127:0/304422709' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "82a40ce4-8f67-4a58-b08d-d7bfdbd447ca"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "82a40ce4-8f67-4a58-b08d-d7bfdbd447ca"} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82a40ce4-8f67-4a58-b08d-d7bfdbd447ca"}]': finished 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: osdmap e18: 5 total, 3 up, 5 in 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:06.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:06.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T03:44:06.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T03:44:06.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='client.24194 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='client.? 10.20.193.127:0/304422709' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "82a40ce4-8f67-4a58-b08d-d7bfdbd447ca"} : dispatch 2026-02-13T03:44:06.550 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "82a40ce4-8f67-4a58-b08d-d7bfdbd447ca"} : dispatch 2026-02-13T03:44:06.551 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:44:06.551 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82a40ce4-8f67-4a58-b08d-d7bfdbd447ca"}]': finished 2026-02-13T03:44:06.551 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: osdmap e18: 5 total, 3 up, 5 in 2026-02-13T03:44:06.551 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:06.551 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:06.551 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:06.551 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:44:06 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3[43455]: 2026-02-13T03:44:06.069+0000 7f35715736c0 -1 osd.3 0 waiting for initial osdmap 2026-02-13T03:44:06.551 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:44:06 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3[43455]: 2026-02-13T03:44:06.071+0000 7f356942f6c0 -1 osd.3 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:44:06.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:06.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T03:44:06.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T03:44:06.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:44:06.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='client.24194 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:06.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='client.? 10.20.193.127:0/304422709' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "82a40ce4-8f67-4a58-b08d-d7bfdbd447ca"} : dispatch 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "82a40ce4-8f67-4a58-b08d-d7bfdbd447ca"} : dispatch 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82a40ce4-8f67-4a58-b08d-d7bfdbd447ca"}]': finished 2026-02-13T03:44:06.704 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: osdmap e18: 5 total, 3 up, 5 in 2026-02-13T03:44:06.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:06.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:06.705 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:07.510 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:44:07.510 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:44:07.510 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:07.510 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: from='client.? 10.20.193.127:0/1683656217' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:07.510 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:07.511 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:07.511 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] boot 2026-02-13T03:44:07.511 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: osdmap e19: 5 total, 4 up, 5 in 2026-02-13T03:44:07.511 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:07.511 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:07 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:07.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:44:07.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:44:07.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:07.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: from='client.? 10.20.193.127:0/1683656217' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:07.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:07.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:07.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] boot 2026-02-13T03:44:07.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: osdmap e19: 5 total, 4 up, 5 in 2026-02-13T03:44:07.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:07.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:07 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:07.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:44:07.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:44:07.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:44:07.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: from='client.? 10.20.193.127:0/1683656217' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:07.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:07.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:07.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: osd.3 [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] boot 2026-02-13T03:44:07.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: osdmap e19: 5 total, 4 up, 5 in 2026-02-13T03:44:07.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:44:07.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:07 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:09.174 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: pgmap v58: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:09.174 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: osdmap e20: 5 total, 4 up, 5 in 2026-02-13T03:44:09.174 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:09.174 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: pgmap v60: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:09.174 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:09.174 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: pgmap v61: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T03:44:09.175 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:09.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: pgmap v58: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: osdmap e20: 5 total, 4 up, 5 in 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: pgmap v60: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: pgmap v61: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:09.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:09.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:09.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:09.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T03:44:09.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:09.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: pgmap v58: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:09.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: osdmap e20: 5 total, 4 up, 5 in 2026-02-13T03:44:09.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:09.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: pgmap v60: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:09.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:09.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:09.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:09.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:09.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:09.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:09.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: pgmap v61: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:09.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:09.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:09.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:09.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T03:44:09.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:10.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:09 trial177 ceph-mon[27082]: pgmap v62: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:10.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:09 trial177 ceph-mon[27082]: osdmap e21: 5 total, 4 up, 5 in 2026-02-13T03:44:10.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:09 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:10.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:09 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:09 trial127 ceph-mon[26439]: pgmap v62: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:09 trial127 ceph-mon[26439]: osdmap e21: 5 total, 4 up, 5 in 2026-02-13T03:44:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:09 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:09 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:10.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:09 trial070 ceph-mon[24757]: pgmap v62: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:10.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:09 trial070 ceph-mon[24757]: osdmap e21: 5 total, 4 up, 5 in 2026-02-13T03:44:10.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:09 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:10.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:09 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:11.177 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:10 trial127 ceph-mon[26439]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T03:44:11.177 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:11.177 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:11.178 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:11.178 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:11.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:10 trial177 ceph-mon[27082]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T03:44:11.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:11.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:11.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:11.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:11.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:10 trial070 ceph-mon[24757]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T03:44:11.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:11.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:11.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:11.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:11.678 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.677+0000 7fdde9ffb6c0 1 -- 10.20.193.127:0/2316935558 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fddf404ca20 con 0x7fddd00b5680 2026-02-13T03:44:11.679 INFO:teuthology.orchestra.run.trial127.stdout:Created osd(s) 4 on host 'trial127' 2026-02-13T03:44:11.681 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fddd00b5680 msgr2=0x7fddd00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:11.681 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fddd00b5680 0x7fddd00d5b30 secure :-1 s=READY pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdde4004750 tx=0x7fdde4009260 comp rx=0 tx=0).stop 2026-02-13T03:44:11.681 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 msgr2=0x7fddf40f49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:11.682 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 0x7fddf40f49a0 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddf000a390 tx=0x7fddf0005670 comp rx=0 tx=0).stop 2026-02-13T03:44:11.682 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 shutdown_connections 2026-02-13T03:44:11.682 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fddd00b5680 0x7fddd00d5b30 unknown :-1 s=CLOSED pgs=98 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:11.682 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fddf410c460 0x7fddf40f49a0 unknown :-1 s=CLOSED pgs=16 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:11.682 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fddf410b8b0 0x7fddf40f3db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:11.682 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 --2- 10.20.193.127:0/2316935558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fddf410ae80 0x7fddf40f3760 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:11.682 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 >> 10.20.193.127:0/2316935558 conn(0x7fddf40e8990 msgr2=0x7fddf40e9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:11.682 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 shutdown_connections 2026-02-13T03:44:11.682 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:11.680+0000 7fddfb1236c0 1 -- 10.20.193.127:0/2316935558 wait complete. 2026-02-13T03:44:11.722 DEBUG:teuthology.orchestra.run.trial127:osd.4> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.4.service 2026-02-13T03:44:11.724 INFO:tasks.cephadm:Deploying osd.5 on trial177 with /dev/vg_nvme/lv_3... 2026-02-13T03:44:11.725 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T03:44:11.849 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:44:12.003 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: pgmap v65: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:12.003 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T03:44:12.003 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:12.003 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.003 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.003 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:12.003 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:12.004 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.004 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:12.004 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:12.004 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:12.004 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='osd.4 [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:44:12.004 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:44:12.004 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.004 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: pgmap v65: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:12.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='osd.4 [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: pgmap v65: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='osd.4 [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:44:12.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:12.312 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:44:12.330 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial177:vg_nvme/lv_3 --skip-validation 2026-02-13T03:44:12.448 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:44:12.570 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/1166423972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d41109f0 msgr2=0x7fa6d4171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:12.570 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/1166423972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d41109f0 0x7fa6d4171380 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=10349262206464933520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6c800aa40 tx=0x7fa6c802fde0 comp rx=0 tx=0).stop 2026-02-13T03:44:12.570 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/1166423972 shutdown_connections 2026-02-13T03:44:12.570 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/1166423972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d41109f0 0x7fa6d4171380 unknown :-1 s=CLOSED pgs=18 gs=1 cs=0 l=1 c_cookie=10349262206464933520 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:12.570 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/1166423972 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa6d4110040 0x7fa6d41104b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:12.570 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/1166423972 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6d410eec0 0x7fa6d410f2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:12.570 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/1166423972 >> 10.20.193.177:0/1166423972 conn(0x7fa6d40ec5c0 msgr2=0x7fa6d410c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/1166423972 shutdown_connections 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/1166423972 wait complete. 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 Processor -- start 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 -- start start 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6d410eec0 0x7fa6d40f8600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d4110040 0x7fa6d4171360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa6d41109f0 0x7fa6d40f8e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40f9a90 con 0x7fa6d41109f0 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40f9c00 con 0x7fa6d410eec0 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d9d206c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40f9dc0 con 0x7fa6d4110040 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d2ffd6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d4110040 0x7fa6d4171360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:12.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d2ffd6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d4110040 0x7fa6d4171360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:33036/0 (socket says 10.20.193.177:33036) 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d2ffd6c0 1 -- 10.20.193.177:0/4106535173 learned_addr learned my addr 10.20.193.177:0/4106535173 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d3fff6c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa6d41109f0 0x7fa6d40f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d37fe6c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6d410eec0 0x7fa6d40f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d2ffd6c0 1 -- 10.20.193.177:0/4106535173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6d410eec0 msgr2=0x7fa6d40f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d2ffd6c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6d410eec0 0x7fa6d40f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d2ffd6c0 1 -- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa6d41109f0 msgr2=0x7fa6d40f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.566+0000 7fa6d2ffd6c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa6d41109f0 0x7fa6d40f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.567+0000 7fa6d2ffd6c0 1 -- 10.20.193.177:0/4106535173 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c800a660 con 0x7fa6d4110040 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.567+0000 7fa6d37fe6c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6d410eec0 0x7fa6d40f8600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.567+0000 7fa6d2ffd6c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d4110040 0x7fa6d4171360 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6c4009490 tx=0x7fa6c400bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:12.572 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.567+0000 7fa6d0ff96c0 1 -- 10.20.193.177:0/4106535173 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6c4004a80 con 0x7fa6d4110040 2026-02-13T03:44:12.573 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.567+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d40fa040 con 0x7fa6d4110040 2026-02-13T03:44:12.573 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.567+0000 7fa6d0ff96c0 1 -- 10.20.193.177:0/4106535173 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa6c4009030 con 0x7fa6d4110040 2026-02-13T03:44:12.573 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.567+0000 7fa6d0ff96c0 1 -- 10.20.193.177:0/4106535173 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6c400ce30 con 0x7fa6d4110040 2026-02-13T03:44:12.573 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.567+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d40fa570 con 0x7fa6d4110040 2026-02-13T03:44:12.573 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.567+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d4175260 con 0x7fa6d4110040 2026-02-13T03:44:12.573 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.568+0000 7fa6d0ff96c0 1 -- 10.20.193.177:0/4106535173 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fa6c4004060 con 0x7fa6d4110040 2026-02-13T03:44:12.574 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.569+0000 7fa6d0ff96c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa6a80b5680 0x7fa6a80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:12.574 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.569+0000 7fa6d0ff96c0 1 -- 10.20.193.177:0/4106535173 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3582+0+0 (secure 0 0 0) 0x7fa6c40e2920 con 0x7fa6d4110040 2026-02-13T03:44:12.574 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.569+0000 7fa6d37fe6c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa6a80b5680 0x7fa6a80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:12.574 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.570+0000 7fa6d37fe6c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa6a80b5680 0x7fa6a80d5b30 secure :-1 s=READY pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6c0004750 tx=0x7fa6c0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:12.574 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.570+0000 7fa6d0ff96c0 1 -- 10.20.193.177:0/4106535173 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa6c40a6500 con 0x7fa6d4110040 2026-02-13T03:44:12.670 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:12.668+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fa6d40f14f0 con 0x7fa6a80b5680 2026-02-13T03:44:13.184 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: pgmap v67: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:13.184 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: pgmap v68: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:13.184 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:13.184 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T03:44:13.184 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T03:44:13.184 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:13.184 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:13.184 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='osd.4 [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:13.184 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:13.185 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.186 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:13.186 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:13.186 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:13.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: pgmap v67: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:13.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: pgmap v68: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:13.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:13.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T03:44:13.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T03:44:13.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:13.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:13.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='osd.4 [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:13.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:13.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:13.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:13.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.227 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:13.227 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:13.227 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.227 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:13.227 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:13.227 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.228 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:13.228 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:13.228 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:13.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: pgmap v67: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:13.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: pgmap v68: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:44:13.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:13.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T03:44:13.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T03:44:13.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:13.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:13.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='osd.4 [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:13.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:13.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:13.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:13.724 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:44:13 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4[37520]: 2026-02-13T03:44:13.288+0000 7fc8b47c46c0 -1 osd.4 0 waiting for initial osdmap 2026-02-13T03:44:13.724 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:44:13 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4[37520]: 2026-02-13T03:44:13.292+0000 7fc8b06886c0 -1 osd.4 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:44:14.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:14.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 199 KiB/s, 0 objects/s recovering 2026-02-13T03:44:14.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:44:14.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T03:44:14.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:14.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:14.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/2423611057' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f96cee85-6197-423b-a006-6d2d85772d6d"} : dispatch 2026-02-13T03:44:14.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f96cee85-6197-423b-a006-6d2d85772d6d"} : dispatch 2026-02-13T03:44:14.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f96cee85-6197-423b-a006-6d2d85772d6d"}]': finished 2026-02-13T03:44:14.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: osd.4 [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] boot 2026-02-13T03:44:14.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: osdmap e26: 6 total, 5 up, 6 in 2026-02-13T03:44:14.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:14.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:14.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/680532467' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:14.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:14.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:13 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:14.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 199 KiB/s, 0 objects/s recovering 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='client.? 10.20.193.177:0/2423611057' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f96cee85-6197-423b-a006-6d2d85772d6d"} : dispatch 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f96cee85-6197-423b-a006-6d2d85772d6d"} : dispatch 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f96cee85-6197-423b-a006-6d2d85772d6d"}]': finished 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: osd.4 [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] boot 2026-02-13T03:44:14.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: osdmap e26: 6 total, 5 up, 6 in 2026-02-13T03:44:14.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:14.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:14.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: from='client.? 10.20.193.177:0/680532467' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:14.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:14.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:13 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:14.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 199 KiB/s, 0 objects/s recovering 2026-02-13T03:44:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:44:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T03:44:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/2423611057' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f96cee85-6197-423b-a006-6d2d85772d6d"} : dispatch 2026-02-13T03:44:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f96cee85-6197-423b-a006-6d2d85772d6d"} : dispatch 2026-02-13T03:44:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f96cee85-6197-423b-a006-6d2d85772d6d"}]': finished 2026-02-13T03:44:14.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: osd.4 [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] boot 2026-02-13T03:44:14.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: osdmap e26: 6 total, 5 up, 6 in 2026-02-13T03:44:14.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:44:14.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:14.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/680532467' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:14.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:14.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:13 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:15.182 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:14 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:44:15.182 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:14 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:44:15.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:14 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:44:15.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:14 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:44:15.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:14 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:44:15.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:14 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:44:16.171 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-13T03:44:16.171 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:16.171 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T03:44:16.172 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:16.172 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:16.172 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:16.172 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:16.172 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:16.172 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:16.172 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:16.172 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:16.172 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:16.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-13T03:44:16.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:16.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T03:44:16.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:16.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:16.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:16.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:16.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:16.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:16.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:16.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:16.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:16.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-13T03:44:16.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:16.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T03:44:16.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:16.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:16.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:16.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:16.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:16.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:16.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:16.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:16.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:17.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:16 trial177 ceph-mon[27082]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T03:44:17.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:16 trial177 ceph-mon[27082]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:17.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:16 trial127 ceph-mon[26439]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T03:44:17.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:16 trial127 ceph-mon[26439]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:17.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:16 trial070 ceph-mon[24757]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T03:44:17.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:16 trial070 ceph-mon[24757]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:18.995 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.994+0000 7fa6d0ff96c0 1 -- 10.20.193.177:0/4106535173 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fa6d40f14f0 con 0x7fa6a80b5680 2026-02-13T03:44:18.996 INFO:teuthology.orchestra.run.trial177.stdout:Created osd(s) 5 on host 'trial177' 2026-02-13T03:44:18.998 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.996+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa6a80b5680 msgr2=0x7fa6a80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:18.998 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.996+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa6a80b5680 0x7fa6a80d5b30 secure :-1 s=READY pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6c0004750 tx=0x7fa6c0009260 comp rx=0 tx=0).stop 2026-02-13T03:44:18.998 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.996+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d4110040 msgr2=0x7fa6d4171360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:18.999 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.996+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d4110040 0x7fa6d4171360 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6c4009490 tx=0x7fa6c400bca0 comp rx=0 tx=0).stop 2026-02-13T03:44:18.999 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.997+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 shutdown_connections 2026-02-13T03:44:18.999 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.997+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa6a80b5680 0x7fa6a80d5b30 unknown :-1 s=CLOSED pgs=103 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:18.999 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.997+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa6d41109f0 0x7fa6d40f8e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:18.999 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.997+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6d4110040 0x7fa6d4171360 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:18.999 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.997+0000 7fa6d9d206c0 1 --2- 10.20.193.177:0/4106535173 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa6d410eec0 0x7fa6d40f8600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:18.999 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.997+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 >> 10.20.193.177:0/4106535173 conn(0x7fa6d40ec5c0 msgr2=0x7fa6d40eebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:18.999 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.997+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 shutdown_connections 2026-02-13T03:44:18.999 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:18.997+0000 7fa6d9d206c0 1 -- 10.20.193.177:0/4106535173 wait complete. 2026-02-13T03:44:19.040 DEBUG:teuthology.orchestra.run.trial177:osd.5> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.5.service 2026-02-13T03:44:19.042 INFO:tasks.cephadm:Deploying osd.6 on trial070 with /dev/vg_nvme/lv_2... 2026-02-13T03:44:19.043 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T03:44:19.161 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:44:19.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:19.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:19.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='osd.5 [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:44:19.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:18 trial177 ceph-mon[27082]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:44:19.216 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:19.217 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:19.218 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='osd.5 [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:44:19.218 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:18 trial070 ceph-mon[24757]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:44:19.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:19.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='osd.5 [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:44:19.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:18 trial127 ceph-mon[26439]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:44:19.613 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:44:19.630 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial070:vg_nvme/lv_2 --skip-validation 2026-02-13T03:44:19.749 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:44:19.869 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.864+0000 7f9b795486c0 1 -- 10.20.193.70:0/1826716952 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b74110050 msgr2=0x7f9b741104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:19.869 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.864+0000 7f9b795486c0 1 --2- 10.20.193.70:0/1826716952 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b74110050 0x7f9b741104c0 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=16643817380522280751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b5c009970 tx=0x7f9b5c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:44:19.869 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.864+0000 7f9b795486c0 1 -- 10.20.193.70:0/1826716952 shutdown_connections 2026-02-13T03:44:19.869 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.864+0000 7f9b795486c0 1 --2- 10.20.193.70:0/1826716952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b74110a00 0x7f9b74171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:19.869 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.864+0000 7f9b795486c0 1 --2- 10.20.193.70:0/1826716952 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b74110050 0x7f9b741104c0 unknown :-1 s=CLOSED pgs=166 gs=1 cs=0 l=1 c_cookie=16643817380522280751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:19.869 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.864+0000 7f9b795486c0 1 --2- 10.20.193.70:0/1826716952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b7410eed0 0x7f9b7410f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.864+0000 7f9b795486c0 1 -- 10.20.193.70:0/1826716952 >> 10.20.193.70:0/1826716952 conn(0x7f9b740ec5f0 msgr2=0x7f9b7410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.864+0000 7f9b795486c0 1 -- 10.20.193.70:0/1826716952 shutdown_connections 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.864+0000 7f9b795486c0 1 -- 10.20.193.70:0/1826716952 wait complete. 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b795486c0 1 Processor -- start 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b795486c0 1 -- start start 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b795486c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b7410eed0 0x7f9b740f8600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b795486c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b74110050 0x7f9b74171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b795486c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b74110a00 0x7f9b740f8e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b795486c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b740f9a90 con 0x7f9b7410eed0 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b795486c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9b740f9c00 con 0x7f9b74110a00 2026-02-13T03:44:19.870 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b795486c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b740f9dc0 con 0x7f9b74110050 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b72ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b7410eed0 0x7f9b740f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b72ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b7410eed0 0x7f9b740f8600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:50946/0 (socket says 10.20.193.70:50946) 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b72ffd6c0 1 -- 10.20.193.70:0/2737271028 learned_addr learned my addr 10.20.193.70:0/2737271028 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b727fc6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b74110050 0x7f9b74171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b737fe6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b74110a00 0x7f9b740f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b72ffd6c0 1 -- 10.20.193.70:0/2737271028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b74110050 msgr2=0x7f9b74171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b72ffd6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b74110050 0x7f9b74171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b72ffd6c0 1 -- 10.20.193.70:0/2737271028 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b74110a00 msgr2=0x7f9b740f8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b72ffd6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b74110a00 0x7f9b740f8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b72ffd6c0 1 -- 10.20.193.70:0/2737271028 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5c009590 con 0x7f9b7410eed0 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b727fc6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b74110050 0x7f9b74171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:44:19.871 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b737fe6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b74110a00 0x7f9b740f8e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:44:19.872 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b72ffd6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b7410eed0 0x7f9b740f8600 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b6800b710 tx=0x7f9b6800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:19.872 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b53fff6c0 1 -- 10.20.193.70:0/2737271028 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b68004250 con 0x7f9b7410eed0 2026-02-13T03:44:19.872 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b53fff6c0 1 -- 10.20.193.70:0/2737271028 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9b68009070 con 0x7f9b7410eed0 2026-02-13T03:44:19.872 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.865+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b740fa0a0 con 0x7f9b7410eed0 2026-02-13T03:44:19.872 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.866+0000 7f9b53fff6c0 1 -- 10.20.193.70:0/2737271028 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b6800ccd0 con 0x7f9b7410eed0 2026-02-13T03:44:19.872 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.866+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b740fa5d0 con 0x7f9b7410eed0 2026-02-13T03:44:19.872 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.866+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b74175250 con 0x7f9b7410eed0 2026-02-13T03:44:19.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.867+0000 7f9b53fff6c0 1 -- 10.20.193.70:0/2737271028 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f9b680028c0 con 0x7f9b7410eed0 2026-02-13T03:44:19.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.868+0000 7f9b53fff6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9b480b5680 0x7f9b480d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:19.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.868+0000 7f9b727fc6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9b480b5680 0x7f9b480d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:19.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.868+0000 7f9b53fff6c0 1 -- 10.20.193.70:0/2737271028 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3993+0+0 (secure 0 0 0) 0x7f9b680e2b90 con 0x7f9b7410eed0 2026-02-13T03:44:19.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.868+0000 7f9b727fc6c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9b480b5680 0x7f9b480d5b30 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b5c005d10 tx=0x7f9b5c005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:19.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.869+0000 7f9b53fff6c0 1 -- 10.20.193.70:0/2737271028 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9b680a6610 con 0x7f9b7410eed0 2026-02-13T03:44:19.972 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:19.970+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f9b740f1560 con 0x7f9b480b5680 2026-02-13T03:44:20.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='osd.5 [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: osdmap e27: 6 total, 5 up, 6 in 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:20.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:20.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:20.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:20.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:20.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='osd.5 [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: osdmap e27: 6 total, 5 up, 6 in 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:20.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:20.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:20.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:20.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:20.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:20.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T03:44:20.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='osd.5 [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:20.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: osdmap e27: 6 total, 5 up, 6 in 2026-02-13T03:44:20.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:20.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:20.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:20.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:20.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:20.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:21.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:21.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:21.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:21.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:21.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3822019552' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8703f159-2f0c-4744-8797-960d48eedfc9"} : dispatch 2026-02-13T03:44:21.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:44:21.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3822019552' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8703f159-2f0c-4744-8797-960d48eedfc9"}]': finished 2026-02-13T03:44:21.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: osdmap e28: 7 total, 5 up, 7 in 2026-02-13T03:44:21.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:21.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:21.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:21.205 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:44:20 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5[38505]: 2026-02-13T03:44:20.781+0000 7f87c4cfa6c0 -1 osd.5 0 waiting for initial osdmap 2026-02-13T03:44:21.205 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:44:20 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5[38505]: 2026-02-13T03:44:20.785+0000 7f87c0bbe6c0 -1 osd.5 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:44:21.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:21.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:21.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:21.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3822019552' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8703f159-2f0c-4744-8797-960d48eedfc9"} : dispatch 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:44:21.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3822019552' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8703f159-2f0c-4744-8797-960d48eedfc9"}]': finished 2026-02-13T03:44:21.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: osdmap e28: 7 total, 5 up, 7 in 2026-02-13T03:44:21.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:21.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:21.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:21.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:21.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:21.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:21.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:21.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:21.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3822019552' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8703f159-2f0c-4744-8797-960d48eedfc9"} : dispatch 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3822019552' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8703f159-2f0c-4744-8797-960d48eedfc9"}]': finished 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: osdmap e28: 7 total, 5 up, 7 in 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:21.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:21.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:22.278 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:44:22.278 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:44:22.278 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:22.278 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3454760390' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:22.278 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:22.279 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:22.279 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: osd.5 [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] boot 2026-02-13T03:44:22.279 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: osdmap e29: 7 total, 6 up, 7 in 2026-02-13T03:44:22.279 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:22.279 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:22.279 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: osdmap e30: 7 total, 6 up, 7 in 2026-02-13T03:44:22.279 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:22.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:44:22.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:44:22.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:22.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3454760390' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:22.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:22.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:22.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: osd.5 [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] boot 2026-02-13T03:44:22.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: osdmap e29: 7 total, 6 up, 7 in 2026-02-13T03:44:22.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:22.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:22.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: osdmap e30: 7 total, 6 up, 7 in 2026-02-13T03:44:22.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:22.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:44:22.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3454760390' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: osd.5 [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] boot 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: osdmap e29: 7 total, 6 up, 7 in 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: osdmap e30: 7 total, 6 up, 7 in 2026-02-13T03:44:22.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:23.276 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:23.276 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:23.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:23.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:23.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:23.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:23.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:23.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:23.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:23.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: osdmap e31: 7 total, 6 up, 7 in 2026-02-13T03:44:23.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:22 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:23.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: osdmap e31: 7 total, 6 up, 7 in 2026-02-13T03:44:23.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:22 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:23.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:23.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:23.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: osdmap e31: 7 total, 6 up, 7 in 2026-02-13T03:44:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:22 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:24.125 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:24 trial070 ceph-mon[24757]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:24.125 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:24 trial070 ceph-mon[24757]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:24.125 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:24 trial070 ceph-mon[24757]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:24.125 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:24 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T03:44:24.126 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:24 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:24.126 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:24 trial070 ceph-mon[24757]: osdmap e32: 7 total, 6 up, 7 in 2026-02-13T03:44:24.126 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:24 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:24.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:24 trial177 ceph-mon[27082]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:24.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:24 trial177 ceph-mon[27082]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:24.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:24 trial177 ceph-mon[27082]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:24.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:24 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T03:44:24.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:24 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:24.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:24 trial177 ceph-mon[27082]: osdmap e32: 7 total, 6 up, 7 in 2026-02-13T03:44:24.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:24 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:24.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:24 trial127 ceph-mon[26439]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:24.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:24 trial127 ceph-mon[26439]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:24.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:24 trial127 ceph-mon[26439]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:24.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:24 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T03:44:24.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:24 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:24.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:24 trial127 ceph-mon[26439]: osdmap e32: 7 total, 6 up, 7 in 2026-02-13T03:44:24.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:24 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:25.260 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:25 trial070 ceph-mon[24757]: pgmap v89: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:25.260 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:25 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:25.260 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:25 trial070 ceph-mon[24757]: osdmap e33: 7 total, 6 up, 7 in 2026-02-13T03:44:25.261 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:25.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:25 trial177 ceph-mon[27082]: pgmap v89: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:25.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:25 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:25.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:25 trial177 ceph-mon[27082]: osdmap e33: 7 total, 6 up, 7 in 2026-02-13T03:44:25.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:25.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:25 trial127 ceph-mon[26439]: pgmap v89: 1 pgs: 1 remapped+peering; 577 KiB data, 159 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:25.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:25 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:25.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:25 trial127 ceph-mon[26439]: osdmap e33: 7 total, 6 up, 7 in 2026-02-13T03:44:25.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:26.226 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:26.227 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.227 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.227 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.227 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.227 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:26.227 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:26.227 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.227 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:26.227 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:26.228 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:26.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.369+0000 7f9b53fff6c0 1 -- 10.20.193.70:0/2737271028 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f9b740f1560 con 0x7f9b480b5680 2026-02-13T03:44:26.371 INFO:teuthology.orchestra.run.trial070.stdout:Created osd(s) 6 on host 'trial070' 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9b480b5680 msgr2=0x7f9b480d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9b480b5680 0x7f9b480d5b30 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b5c005d10 tx=0x7f9b5c005c20 comp rx=0 tx=0).stop 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b7410eed0 msgr2=0x7f9b740f8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b7410eed0 0x7f9b740f8600 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b6800b710 tx=0x7f9b6800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 shutdown_connections 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9b480b5680 0x7f9b480d5b30 unknown :-1 s=CLOSED pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9b74110a00 0x7f9b740f8e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b74110050 0x7f9b74171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 --2- 10.20.193.70:0/2737271028 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9b7410eed0 0x7f9b740f8600 unknown :-1 s=CLOSED pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:26.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 >> 10.20.193.70:0/2737271028 conn(0x7f9b740ec5f0 msgr2=0x7f9b740eebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:26.375 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 shutdown_connections 2026-02-13T03:44:26.375 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:26.371+0000 7f9b795486c0 1 -- 10.20.193.70:0/2737271028 wait complete. 2026-02-13T03:44:26.416 DEBUG:teuthology.orchestra.run.trial070:osd.6> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.6.service 2026-02-13T03:44:26.418 INFO:tasks.cephadm:Deploying osd.7 on trial127 with /dev/vg_nvme/lv_2... 2026-02-13T03:44:26.418 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T03:44:26.442 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:26.442 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.442 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.442 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.442 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.442 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:26.442 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:26.442 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.442 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:26.443 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:26.443 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:26.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:26.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:26.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:26.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:26.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:26.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:26.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:26.535 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.b/config 2026-02-13T03:44:26.975 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:44:26.993 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial127:vg_nvme/lv_2 --skip-validation 2026-02-13T03:44:27.153 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.b/config 2026-02-13T03:44:27.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:27 trial127 ceph-mon[26439]: pgmap v92: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:27.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:27 trial127 ceph-mon[26439]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:27.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:27 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:27.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:27 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:27.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:27 trial127 ceph-mon[26439]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:44:27.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:27.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:27.203 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:27.280 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 -- 10.20.193.127:0/1667543675 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 msgr2=0x7fcc9010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/1667543675 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 0x7fcc9010f2b0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=18316758811209884625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc84009970 tx=0x7fcc8402ed20 comp rx=0 tx=0).stop 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 -- 10.20.193.127:0/1667543675 shutdown_connections 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/1667543675 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcc901109f0 0x7fcc90171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/1667543675 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcc90110040 0x7fcc901104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/1667543675 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 0x7fcc9010f2b0 unknown :-1 s=CLOSED pgs=24 gs=1 cs=0 l=1 c_cookie=18316758811209884625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 -- 10.20.193.127:0/1667543675 >> 10.20.193.127:0/1667543675 conn(0x7fcc900ec5c0 msgr2=0x7fcc9010c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 -- 10.20.193.127:0/1667543675 shutdown_connections 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 -- 10.20.193.127:0/1667543675 wait complete. 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 Processor -- start 2026-02-13T03:44:27.281 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 -- start start 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 0x7fcc900f8700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcc90110040 0x7fcc90171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcc901109f0 0x7fcc900f8f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcc900f9b90 con 0x7fcc901109f0 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcc900f9d00 con 0x7fcc9010eec0 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc94e806c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcc900f9ec0 con 0x7fcc90110040 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc8e5756c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 0x7fcc900f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc8e5756c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 0x7fcc900f8700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.127:51412/0 (socket says 10.20.193.127:51412) 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.277+0000 7fcc8e5756c0 1 -- 10.20.193.127:0/47710389 learned_addr learned my addr 10.20.193.127:0/47710389 (peer_addr_for_me v2:10.20.193.127:0/0) 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc8e5756c0 1 -- 10.20.193.127:0/47710389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcc90110040 msgr2=0x7fcc90171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:27.282 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc8e5756c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcc90110040 0x7fcc90171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc8e5756c0 1 -- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcc901109f0 msgr2=0x7fcc900f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc8ed766c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcc901109f0 0x7fcc900f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc8e5756c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcc901109f0 0x7fcc900f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc8e5756c0 1 -- 10.20.193.127:0/47710389 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc84009590 con 0x7fcc9010eec0 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc8ed766c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcc901109f0 0x7fcc900f8f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc8e5756c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 0x7fcc900f8700 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc840092b0 tx=0x7fcc840046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc777fe6c0 1 -- 10.20.193.127:0/47710389 <== mon.2 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc84002b60 con 0x7fcc9010eec0 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc900fa140 con 0x7fcc9010eec0 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc777fe6c0 1 -- 10.20.193.127:0/47710389 <== mon.2 v2:10.20.193.127:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcc84007680 con 0x7fcc9010eec0 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc777fe6c0 1 -- 10.20.193.127:0/47710389 <== mon.2 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc840365d0 con 0x7fcc9010eec0 2026-02-13T03:44:27.283 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc900fa5c0 con 0x7fcc9010eec0 2026-02-13T03:44:27.284 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.278+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc90175260 con 0x7fcc9010eec0 2026-02-13T03:44:27.285 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.280+0000 7fcc777fe6c0 1 -- 10.20.193.127:0/47710389 <== mon.2 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fcc84007cd0 con 0x7fcc9010eec0 2026-02-13T03:44:27.285 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.280+0000 7fcc777fe6c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcc680b5600 0x7fcc680d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:27.285 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.280+0000 7fcc777fe6c0 1 -- 10.20.193.127:0/47710389 <== mon.2 v2:10.20.193.127:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4446+0+0 (secure 0 0 0) 0x7fcc84106ea0 con 0x7fcc9010eec0 2026-02-13T03:44:27.285 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.280+0000 7fcc8dd746c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcc680b5600 0x7fcc680d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:27.285 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.281+0000 7fcc777fe6c0 1 -- 10.20.193.127:0/47710389 <== mon.2 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcc840ca7b0 con 0x7fcc9010eec0 2026-02-13T03:44:27.285 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.281+0000 7fcc8dd746c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcc680b5600 0x7fcc680d5ab0 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc78005980 tx=0x7fcc78005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:27.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:27 trial070 ceph-mon[24757]: pgmap v92: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:27.305 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:27 trial070 ceph-mon[24757]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:27.305 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:27 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:27.305 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:27 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:27.305 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:27 trial070 ceph-mon[24757]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:44:27.305 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:27.305 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:27.305 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:27.380 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:27.379+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fcc9004ca20 con 0x7fcc680b5600 2026-02-13T03:44:27.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:27 trial177 ceph-mon[27082]: pgmap v92: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:27.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:27 trial177 ceph-mon[27082]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:27.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:27 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:27.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:27 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:27.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:27 trial177 ceph-mon[27082]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:44:27.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:27.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:27.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:28.272 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:28.272 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T03:44:28.272 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T03:44:28.272 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:44:28.272 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:28.273 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:28.274 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.274 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:28.274 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:28.274 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.274 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:28.274 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:28.274 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:28.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:28.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T03:44:28.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T03:44:28.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:44:28.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:28.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:28.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:28.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:28.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:28.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:28.300 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:44:28 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:44:28.010+0000 7f5712fcf6c0 -1 osd.6 0 waiting for initial osdmap 2026-02-13T03:44:28.300 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:44:28 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:44:28.014+0000 7f570ee936c0 -1 osd.6 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:44:28.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:28.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:28.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:28.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:29.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 158 KiB/s, 0 objects/s recovering 2026-02-13T03:44:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:44:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T03:44:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7203c134-bbbb-4980-b512-a49cb17481d7"} : dispatch 2026-02-13T03:44:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='client.? 10.20.193.127:0/2117513124' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7203c134-bbbb-4980-b512-a49cb17481d7"} : dispatch 2026-02-13T03:44:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7203c134-bbbb-4980-b512-a49cb17481d7"}]': finished 2026-02-13T03:44:29.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] boot 2026-02-13T03:44:29.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: osdmap e36: 8 total, 7 up, 8 in 2026-02-13T03:44:29.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:29.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:29.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: from='client.? 10.20.193.127:0/3964657069' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:29.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:29.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:29 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:29.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:29.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 158 KiB/s, 0 objects/s recovering 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7203c134-bbbb-4980-b512-a49cb17481d7"} : dispatch 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='client.? 10.20.193.127:0/2117513124' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7203c134-bbbb-4980-b512-a49cb17481d7"} : dispatch 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7203c134-bbbb-4980-b512-a49cb17481d7"}]': finished 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] boot 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: osdmap e36: 8 total, 7 up, 8 in 2026-02-13T03:44:29.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:29.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:29.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: from='client.? 10.20.193.127:0/3964657069' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:29.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:29.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:29 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:29.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:29.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 158 KiB/s, 0 objects/s recovering 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7203c134-bbbb-4980-b512-a49cb17481d7"} : dispatch 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='client.? 10.20.193.127:0/2117513124' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7203c134-bbbb-4980-b512-a49cb17481d7"} : dispatch 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7203c134-bbbb-4980-b512-a49cb17481d7"}]': finished 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: osd.6 [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] boot 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: osdmap e36: 8 total, 7 up, 8 in 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:44:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:29.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: from='client.? 10.20.193.127:0/3964657069' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:29.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:29.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:29 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:30.151 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:30 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:44:30.151 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:30 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:44:30.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:30 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:44:30.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:30 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:44:30.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:30 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:44:30.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:30 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:44:31.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T03:44:31.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 170 KiB/s, 0 objects/s recovering 2026-02-13T03:44:31.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:31.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:31.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:31.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:31.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:31.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:31.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 185 KiB/s, 0 objects/s recovering 2026-02-13T03:44:31.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:31.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:31.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:31.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T03:44:31.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:31 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:31.316 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T03:44:31.316 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 170 KiB/s, 0 objects/s recovering 2026-02-13T03:44:31.316 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:31.316 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:31.316 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:31.316 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:31.316 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:31.316 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:31.317 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 185 KiB/s, 0 objects/s recovering 2026-02-13T03:44:31.317 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:31.317 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:31.317 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:31.317 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T03:44:31.317 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:31 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:31.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T03:44:31.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 170 KiB/s, 0 objects/s recovering 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail; 185 KiB/s, 0 objects/s recovering 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:31.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T03:44:31.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:31 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:32.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:32 trial070 ceph-mon[24757]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:32.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:32 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:32.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:32 trial177 ceph-mon[27082]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:32.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:32 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:32.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:32 trial127 ceph-mon[26439]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:32.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:32 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:33 trial127 ceph-mon[26439]: osdmap e37: 8 total, 7 up, 8 in 2026-02-13T03:44:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:33 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:33 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:33 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:33 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:33.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:33 trial070 ceph-mon[24757]: osdmap e37: 8 total, 7 up, 8 in 2026-02-13T03:44:33.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:33 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:33.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:33 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:33.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:33 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:33.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:33 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:33.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:33 trial177 ceph-mon[27082]: osdmap e37: 8 total, 7 up, 8 in 2026-02-13T03:44:33.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:33 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:33.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:33 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:33.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:33 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:33.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:33 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:33.787 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.785+0000 7fcc777fe6c0 1 -- 10.20.193.127:0/47710389 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fcc9004ca20 con 0x7fcc680b5600 2026-02-13T03:44:33.787 INFO:teuthology.orchestra.run.trial127.stdout:Created osd(s) 7 on host 'trial127' 2026-02-13T03:44:33.789 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcc680b5600 msgr2=0x7fcc680d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:33.790 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcc680b5600 0x7fcc680d5ab0 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc78005980 tx=0x7fcc78005910 comp rx=0 tx=0).stop 2026-02-13T03:44:33.790 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 msgr2=0x7fcc900f8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:33.790 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 0x7fcc900f8700 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc840092b0 tx=0x7fcc840046e0 comp rx=0 tx=0).stop 2026-02-13T03:44:33.790 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 shutdown_connections 2026-02-13T03:44:33.790 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcc680b5600 0x7fcc680d5ab0 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:33.790 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcc901109f0 0x7fcc900f8f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:33.790 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcc90110040 0x7fcc90171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:33.790 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 --2- 10.20.193.127:0/47710389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcc9010eec0 0x7fcc900f8700 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:33.790 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 >> 10.20.193.127:0/47710389 conn(0x7fcc900ec5c0 msgr2=0x7fcc900eec30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:33.791 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 shutdown_connections 2026-02-13T03:44:33.791 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:33.787+0000 7fcc94e806c0 1 -- 10.20.193.127:0/47710389 wait complete. 2026-02-13T03:44:33.832 DEBUG:teuthology.orchestra.run.trial127:osd.7> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.7.service 2026-02-13T03:44:33.834 INFO:tasks.cephadm:Deploying osd.8 on trial177 with /dev/vg_nvme/lv_2... 2026-02-13T03:44:33.835 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T03:44:33.957 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:44:34.170 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:34.170 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.170 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.170 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:34.170 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:34.170 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.170 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:34.171 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:34.171 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:34.171 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:44:34.171 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='osd.7 [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:44:34.171 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.171 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:34 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:44:34.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='osd.7 [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:44:34.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:34 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.389 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:44:34.390 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:34.390 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.390 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.390 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:34.391 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:34.391 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.391 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:34.391 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:34.391 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:34.391 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:44:34.391 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='osd.7 [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:44:34.391 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.391 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:34 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:34.406 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial177:vg_nvme/lv_2 --skip-validation 2026-02-13T03:44:34.526 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:44:34.646 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 -- 10.20.193.177:0/1352399433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4181109f0 msgr2=0x7fb418171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:34.646 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/1352399433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4181109f0 0x7fb418171380 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=11087871349782039101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb41400aa40 tx=0x7fb41402fde0 comp rx=0 tx=0).stop 2026-02-13T03:44:34.647 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 -- 10.20.193.177:0/1352399433 shutdown_connections 2026-02-13T03:44:34.647 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/1352399433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4181109f0 0x7fb418171380 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=11087871349782039101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:34.647 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/1352399433 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb418110040 0x7fb4181104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:34.647 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/1352399433 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb41810eec0 0x7fb41810f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:34.647 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 -- 10.20.193.177:0/1352399433 >> 10.20.193.177:0/1352399433 conn(0x7fb4180ec5c0 msgr2=0x7fb41810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:34.647 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 -- 10.20.193.177:0/1352399433 shutdown_connections 2026-02-13T03:44:34.647 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 -- 10.20.193.177:0/1352399433 wait complete. 2026-02-13T03:44:34.647 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 Processor -- start 2026-02-13T03:44:34.647 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 -- start start 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb41810eec0 0x7fb4180f8600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb418110040 0x7fb418171360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4181109f0 0x7fb4180f8e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb4180f9a90 con 0x7fb4181109f0 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb4180f9c00 con 0x7fb41810eec0 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41edc06c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4180f9dc0 con 0x7fb418110040 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb40ffff6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb418110040 0x7fb418171360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb40ffff6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb418110040 0x7fb418171360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:55792/0 (socket says 10.20.193.177:55792) 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb40ffff6c0 1 -- 10.20.193.177:0/25567830 learned_addr learned my addr 10.20.193.177:0/25567830 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41d3326c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4181109f0 0x7fb4180f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb41cb316c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb41810eec0 0x7fb4180f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:34.648 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb40ffff6c0 1 -- 10.20.193.177:0/25567830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb41810eec0 msgr2=0x7fb4180f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb40ffff6c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb41810eec0 0x7fb4180f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb40ffff6c0 1 -- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4181109f0 msgr2=0x7fb4180f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb40ffff6c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4181109f0 0x7fb4180f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.642+0000 7fb40ffff6c0 1 -- 10.20.193.177:0/25567830 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41400a660 con 0x7fb418110040 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.643+0000 7fb40ffff6c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb418110040 0x7fb418171360 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb40000b710 tx=0x7fb40000bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.643+0000 7fb40dffb6c0 1 -- 10.20.193.177:0/25567830 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb400004250 con 0x7fb418110040 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.643+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4180fa040 con 0x7fb418110040 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.643+0000 7fb40dffb6c0 1 -- 10.20.193.177:0/25567830 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb400002d80 con 0x7fb418110040 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.643+0000 7fb40dffb6c0 1 -- 10.20.193.177:0/25567830 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb40000cdc0 con 0x7fb418110040 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.643+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4180fa570 con 0x7fb418110040 2026-02-13T03:44:34.649 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.643+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4181752b0 con 0x7fb418110040 2026-02-13T03:44:34.650 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.645+0000 7fb40dffb6c0 1 -- 10.20.193.177:0/25567830 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fb4000028c0 con 0x7fb418110040 2026-02-13T03:44:34.651 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.645+0000 7fb40dffb6c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3f40b5680 0x7fb3f40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:34.651 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.645+0000 7fb40dffb6c0 1 -- 10.20.193.177:0/25567830 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4878+0+0 (secure 0 0 0) 0x7fb4000e2eb0 con 0x7fb418110040 2026-02-13T03:44:34.651 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.645+0000 7fb41cb316c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3f40b5680 0x7fb3f40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:34.651 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.646+0000 7fb40dffb6c0 1 -- 10.20.193.177:0/25567830 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb4000a6580 con 0x7fb418110040 2026-02-13T03:44:34.651 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.646+0000 7fb41cb316c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3f40b5680 0x7fb3f40d5b30 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb408005980 tx=0x7fb408005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:34.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:34.744+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb4180f14f0 con 0x7fb3f40b5680 2026-02-13T03:44:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T03:44:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: osdmap e38: 8 total, 7 up, 8 in 2026-02-13T03:44:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='osd.7 [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:35.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:35.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:35.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:35.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:35.226 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:35 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:35.278 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: osdmap e38: 8 total, 7 up, 8 in 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='osd.7 [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.279 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:35.280 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.281 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:35.281 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:35.281 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:35 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:35.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:35.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:35.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:35.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T03:44:35.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: osdmap e38: 8 total, 7 up, 8 in 2026-02-13T03:44:35.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:35.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:35.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='osd.7 [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:35.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:35.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:35.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:35.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:35.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:35.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:35 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:35.723 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:44:35 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:44:35.414+0000 7f6d4362a6c0 -1 osd.7 0 waiting for initial osdmap 2026-02-13T03:44:35.724 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:44:35 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:44:35.419+0000 7f6d3b4e66c0 -1 osd.7 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:44:36.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:44:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: osdmap e39: 8 total, 7 up, 8 in 2026-02-13T03:44:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/2853335240' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1771e760-778b-4f83-a0c5-12eeee43c768"} : dispatch 2026-02-13T03:44:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1771e760-778b-4f83-a0c5-12eeee43c768"} : dispatch 2026-02-13T03:44:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1771e760-778b-4f83-a0c5-12eeee43c768"}]': finished 2026-02-13T03:44:36.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: osd.7 [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] boot 2026-02-13T03:44:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: osdmap e40: 9 total, 8 up, 9 in 2026-02-13T03:44:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/401117299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:36.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:36 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:44:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: osdmap e39: 8 total, 7 up, 8 in 2026-02-13T03:44:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/2853335240' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1771e760-778b-4f83-a0c5-12eeee43c768"} : dispatch 2026-02-13T03:44:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1771e760-778b-4f83-a0c5-12eeee43c768"} : dispatch 2026-02-13T03:44:36.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1771e760-778b-4f83-a0c5-12eeee43c768"}]': finished 2026-02-13T03:44:36.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: osd.7 [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] boot 2026-02-13T03:44:36.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: osdmap e40: 9 total, 8 up, 9 in 2026-02-13T03:44:36.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:36.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:36.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/401117299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:36.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:36.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:36 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:44:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: osdmap e39: 8 total, 7 up, 8 in 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.177:0/2853335240' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1771e760-778b-4f83-a0c5-12eeee43c768"} : dispatch 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1771e760-778b-4f83-a0c5-12eeee43c768"} : dispatch 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1771e760-778b-4f83-a0c5-12eeee43c768"}]': finished 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: osd.7 [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] boot 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: osdmap e40: 9 total, 8 up, 9 in 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:36.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.177:0/401117299' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:36.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:36.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:36 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:37.804 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:44:37.805 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:44:37.805 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: osdmap e41: 9 total, 8 up, 9 in 2026-02-13T03:44:37.805 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:37.805 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:37.805 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:37.805 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:37.805 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:37.805 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:37.806 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:37.806 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:37.806 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:37.806 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:37.806 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:37 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:37.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:44:37.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: osdmap e41: 9 total, 8 up, 9 in 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:37.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:37.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:37.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:37 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:38.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: osdmap e41: 9 total, 8 up, 9 in 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:38.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:38.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:38.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:37 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:38.875 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:38 trial127 ceph-mon[26439]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:38.875 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:38 trial127 ceph-mon[26439]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:38.875 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:38 trial127 ceph-mon[26439]: osdmap e42: 9 total, 8 up, 9 in 2026-02-13T03:44:38.875 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:38 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:38.875 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:38 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T03:44:38.875 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:38 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:38.875 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:38 trial127 ceph-mon[26439]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:38.879 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:38 trial177 ceph-mon[27082]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:38.879 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:38 trial177 ceph-mon[27082]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:38.879 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:38 trial177 ceph-mon[27082]: osdmap e42: 9 total, 8 up, 9 in 2026-02-13T03:44:38.879 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:38 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:38.880 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:38 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T03:44:38.880 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:38 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:38.880 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:38 trial177 ceph-mon[27082]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:39.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:38 trial070 ceph-mon[24757]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:39.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:38 trial070 ceph-mon[24757]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:39.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:38 trial070 ceph-mon[24757]: osdmap e42: 9 total, 8 up, 9 in 2026-02-13T03:44:39.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:38 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:39.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:38 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T03:44:39.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:38 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:39.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:38 trial070 ceph-mon[24757]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:39.842 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:39 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:39.842 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:39 trial177 ceph-mon[27082]: osdmap e43: 9 total, 8 up, 9 in 2026-02-13T03:44:39.843 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:39 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:39.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:39 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:39.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:39 trial127 ceph-mon[26439]: osdmap e43: 9 total, 8 up, 9 in 2026-02-13T03:44:39.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:39 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:40.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:39 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:40.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:39 trial070 ceph-mon[24757]: osdmap e43: 9 total, 8 up, 9 in 2026-02-13T03:44:40.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:39 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:40.620 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:40 trial177 ceph-mon[27082]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T03:44:40.620 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:40 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:40.620 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:40 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:40.620 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:40 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:40.620 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:40 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:40.621 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:40 trial177 ceph-mon[27082]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:40.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:40 trial127 ceph-mon[26439]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T03:44:40.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:40 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:40.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:40 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:40.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:40 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:40.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:40 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:40.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:40 trial127 ceph-mon[26439]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:41.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:40 trial070 ceph-mon[24757]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T03:44:41.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:40 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:41.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:40 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:41.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:40 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:41.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:40 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:41.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:40 trial070 ceph-mon[24757]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:41.149 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.146+0000 7fb40dffb6c0 1 -- 10.20.193.177:0/25567830 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb4180f14f0 con 0x7fb3f40b5680 2026-02-13T03:44:41.149 INFO:teuthology.orchestra.run.trial177.stdout:Created osd(s) 8 on host 'trial177' 2026-02-13T03:44:41.151 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3f40b5680 msgr2=0x7fb3f40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:41.151 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3f40b5680 0x7fb3f40d5b30 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb408005980 tx=0x7fb408005910 comp rx=0 tx=0).stop 2026-02-13T03:44:41.151 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb418110040 msgr2=0x7fb418171360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:41.151 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb418110040 0x7fb418171360 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb40000b710 tx=0x7fb40000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:44:41.151 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 shutdown_connections 2026-02-13T03:44:41.151 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3f40b5680 0x7fb3f40d5b30 unknown :-1 s=CLOSED pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:41.152 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4181109f0 0x7fb4180f8e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:41.152 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb418110040 0x7fb418171360 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:41.152 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 --2- 10.20.193.177:0/25567830 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb41810eec0 0x7fb4180f8600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:41.152 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 >> 10.20.193.177:0/25567830 conn(0x7fb4180ec5c0 msgr2=0x7fb4180eebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:41.152 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 shutdown_connections 2026-02-13T03:44:41.152 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:41.149+0000 7fb41edc06c0 1 -- 10.20.193.177:0/25567830 wait complete. 2026-02-13T03:44:41.194 DEBUG:teuthology.orchestra.run.trial177:osd.8> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.8.service 2026-02-13T03:44:41.197 INFO:tasks.cephadm:Deploying osd.9 on trial070 with /dev/vg_nvme/lv_1... 2026-02-13T03:44:41.197 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T03:44:41.319 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:44:41.782 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:44:41.798 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial070:vg_nvme/lv_1 --skip-validation 2026-02-13T03:44:41.916 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:44:41.975 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: pgmap v120: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='osd.8 [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:44:41.976 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:41.977 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:41.977 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:41.977 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:41.977 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:41 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:42.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/3995719359 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 msgr2=0x7fb1f010d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:42.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/3995719359 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 0x7fb1f010d040 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=8086951542937951087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1e0009970 tx=0x7fb1e002ed20 comp rx=0 tx=0).stop 2026-02-13T03:44:42.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/3995719359 shutdown_connections 2026-02-13T03:44:42.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/3995719359 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1f010e780 0x7fb1f016f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:42.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/3995719359 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1f010ddd0 0x7fb1f010e240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/3995719359 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 0x7fb1f010d040 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=8086951542937951087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/3995719359 >> 10.20.193.70:0/3995719359 conn(0x7fb1f00ea370 msgr2=0x7fb1f010a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/3995719359 shutdown_connections 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/3995719359 wait complete. 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 Processor -- start 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.033+0000 7fb1f7fc16c0 1 -- start start 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f7fc16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 0x7fb1f00f6380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f7fc16c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1f010ddd0 0x7fb1f016f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f7fc16c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1f010e780 0x7fb1f00f6be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f7fc16c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00f7810 con 0x7fb1f010cc50 2026-02-13T03:44:42.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f7fc16c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00f7980 con 0x7fb1f010e780 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f7fc16c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00f7b40 con 0x7fb1f010ddd0 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f5d326c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 0x7fb1f00f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f5d326c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 0x7fb1f00f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:60680/0 (socket says 10.20.193.70:60680) 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f5d326c0 1 -- 10.20.193.70:0/695885220 learned_addr learned my addr 10.20.193.70:0/695885220 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f65336c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1f010e780 0x7fb1f00f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f5d326c0 1 -- 10.20.193.70:0/695885220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1f010ddd0 msgr2=0x7fb1f016f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f55316c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1f010ddd0 0x7fb1f016f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f5d326c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1f010ddd0 0x7fb1f016f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f5d326c0 1 -- 10.20.193.70:0/695885220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1f010e780 msgr2=0x7fb1f00f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f5d326c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1f010e780 0x7fb1f00f6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:42.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f5d326c0 1 -- 10.20.193.70:0/695885220 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e0009590 con 0x7fb1f010cc50 2026-02-13T03:44:42.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f55316c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1f010ddd0 0x7fb1f016f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:44:42.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f65336c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1f010e780 0x7fb1f00f6be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:44:42.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f5d326c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 0x7fb1f00f6380 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1e00092e0 tx=0x7fb1e0004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:42.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1deffd6c0 1 -- 10.20.193.70:0/695885220 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1e0002ae0 con 0x7fb1f010cc50 2026-02-13T03:44:42.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f00f7dc0 con 0x7fb1f010cc50 2026-02-13T03:44:42.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1deffd6c0 1 -- 10.20.193.70:0/695885220 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb1e0007680 con 0x7fb1f010cc50 2026-02-13T03:44:42.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1deffd6c0 1 -- 10.20.193.70:0/695885220 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1e0037650 con 0x7fb1f010cc50 2026-02-13T03:44:42.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.034+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f00f8290 con 0x7fb1f010cc50 2026-02-13T03:44:42.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.035+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f0172fd0 con 0x7fb1f010cc50 2026-02-13T03:44:42.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.036+0000 7fb1deffd6c0 1 -- 10.20.193.70:0/695885220 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fb1e0007cf0 con 0x7fb1f010cc50 2026-02-13T03:44:42.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.037+0000 7fb1deffd6c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1cc0b5600 0x7fb1cc0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:42.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.037+0000 7fb1f55316c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1cc0b5600 0x7fb1cc0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:42.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.037+0000 7fb1deffd6c0 1 -- 10.20.193.70:0/695885220 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5310+0+0 (secure 0 0 0) 0x7fb1e01072b0 con 0x7fb1f010cc50 2026-02-13T03:44:42.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.037+0000 7fb1f55316c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1cc0b5600 0x7fb1cc0d5ab0 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1e4004750 tx=0x7fb1e4005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:42.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.037+0000 7fb1deffd6c0 1 -- 10.20.193.70:0/695885220 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb1e00ca7d0 con 0x7fb1f010cc50 2026-02-13T03:44:42.139 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:42.137+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb1f004ca20 con 0x7fb1cc0b5600 2026-02-13T03:44:42.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:42.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:42.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: pgmap v120: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:42.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:42.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:42.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:42.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='osd.8 [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:44:42.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:44:42.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:42.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:42.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:41 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:42.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: pgmap v120: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='osd.8 [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:42.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:42.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:41 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:43.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:43.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T03:44:43.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T03:44:43.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:43.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='osd.8 [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:43.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:43.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:43.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:43.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:43.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:43.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:43.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:42 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:43.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:43.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T03:44:43.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T03:44:43.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:43.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='osd.8 [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:43.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:43.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:43.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:43.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:43.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:43.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:43.204 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:42 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:43.204 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:44:42 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:44:42.754+0000 7f7af65296c0 -1 osd.8 0 waiting for initial osdmap 2026-02-13T03:44:43.204 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:44:42 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:44:42.759+0000 7f7aee3e56c0 -1 osd.8 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:44:43.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:43.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T03:44:43.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='osd.8 [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial070:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:43.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:42 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:44.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:44.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:44:44.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T03:44:44.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:44.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:44.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1497903925' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2ad7ff96-14be-4cb9-9b52-1a00e064de38"} : dispatch 2026-02-13T03:44:44.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1497903925' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ad7ff96-14be-4cb9-9b52-1a00e064de38"}]': finished 2026-02-13T03:44:44.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: osd.8 [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] boot 2026-02-13T03:44:44.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: osdmap e47: 10 total, 9 up, 10 in 2026-02-13T03:44:44.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:44.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:44.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3337417327' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:44.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:44.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:43 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:44.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1497903925' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2ad7ff96-14be-4cb9-9b52-1a00e064de38"} : dispatch 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1497903925' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ad7ff96-14be-4cb9-9b52-1a00e064de38"}]': finished 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: osd.8 [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] boot 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: osdmap e47: 10 total, 9 up, 10 in 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:44.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:44.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3337417327' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:44.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:44.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:43 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:44.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:44:44.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:44:44.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T03:44:44.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1497903925' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2ad7ff96-14be-4cb9-9b52-1a00e064de38"} : dispatch 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1497903925' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ad7ff96-14be-4cb9-9b52-1a00e064de38"}]': finished 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: osd.8 [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] boot 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: osdmap e47: 10 total, 9 up, 10 in 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3337417327' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:44.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:43 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:45.257 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:44:45.257 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: osdmap e48: 10 total, 9 up, 10 in 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:45.258 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:45.259 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:44 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:45.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: osdmap e48: 10 total, 9 up, 10 in 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:45.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:45.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:45.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:44 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:44:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:44:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: osdmap e48: 10 total, 9 up, 10 in 2026-02-13T03:44:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:45.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:44 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:46.113 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:45 trial070 ceph-mon[24757]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:46.114 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:45 trial070 ceph-mon[24757]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:46.114 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:45 trial070 ceph-mon[24757]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:46.114 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:45 trial070 ceph-mon[24757]: osdmap e49: 10 total, 9 up, 10 in 2026-02-13T03:44:46.114 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:45 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:46.114 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:45 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T03:44:46.114 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:45 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:46.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:45 trial177 ceph-mon[27082]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:45 trial177 ceph-mon[27082]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:45 trial177 ceph-mon[27082]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:45 trial177 ceph-mon[27082]: osdmap e49: 10 total, 9 up, 10 in 2026-02-13T03:44:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:45 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:45 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T03:44:46.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:45 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:46.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:45 trial127 ceph-mon[26439]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:46.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:45 trial127 ceph-mon[26439]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:46.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:45 trial127 ceph-mon[26439]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:46.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:45 trial127 ceph-mon[26439]: osdmap e49: 10 total, 9 up, 10 in 2026-02-13T03:44:46.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:45 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:46.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:45 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T03:44:46.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:45 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:47.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:46 trial070 ceph-mon[24757]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:47.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:46 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:47.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:46 trial070 ceph-mon[24757]: osdmap e50: 10 total, 9 up, 10 in 2026-02-13T03:44:47.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:46 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:47.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:46 trial177 ceph-mon[27082]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:47.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:46 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:47.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:46 trial177 ceph-mon[27082]: osdmap e50: 10 total, 9 up, 10 in 2026-02-13T03:44:47.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:46 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:47.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:46 trial127 ceph-mon[26439]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T03:44:47.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:46 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:47.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:46 trial127 ceph-mon[26439]: osdmap e50: 10 total, 9 up, 10 in 2026-02-13T03:44:47.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:46 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:48.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:47 trial070 ceph-mon[24757]: osdmap e51: 10 total, 9 up, 10 in 2026-02-13T03:44:48.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:47 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:48.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:47 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:48.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:47 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:47 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:47 trial177 ceph-mon[27082]: osdmap e51: 10 total, 9 up, 10 in 2026-02-13T03:44:48.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:47 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:48.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:47 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:48.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:47 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:47 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:47 trial127 ceph-mon[26439]: osdmap e51: 10 total, 9 up, 10 in 2026-02-13T03:44:48.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:47 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:48.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:47 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:48.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:47 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:47 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.664 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.662+0000 7fb1deffd6c0 1 -- 10.20.193.70:0/695885220 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb1f004ca20 con 0x7fb1cc0b5600 2026-02-13T03:44:48.665 INFO:teuthology.orchestra.run.trial070.stdout:Created osd(s) 9 on host 'trial070' 2026-02-13T03:44:48.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1cc0b5600 msgr2=0x7fb1cc0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1cc0b5600 0x7fb1cc0d5ab0 secure :-1 s=READY pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1e4004750 tx=0x7fb1e4005f10 comp rx=0 tx=0).stop 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 msgr2=0x7fb1f00f6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 0x7fb1f00f6380 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1e00092e0 tx=0x7fb1e0004670 comp rx=0 tx=0).stop 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 shutdown_connections 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1cc0b5600 0x7fb1cc0d5ab0 unknown :-1 s=CLOSED pgs=123 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb1f010e780 0x7fb1f00f6be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1f010ddd0 0x7fb1f016f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 --2- 10.20.193.70:0/695885220 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb1f010cc50 0x7fb1f00f6380 unknown :-1 s=CLOSED pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 >> 10.20.193.70:0/695885220 conn(0x7fb1f00ea370 msgr2=0x7fb1f00ec960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:48.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 shutdown_connections 2026-02-13T03:44:48.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:44:48.665+0000 7fb1f7fc16c0 1 -- 10.20.193.70:0/695885220 wait complete. 2026-02-13T03:44:48.709 DEBUG:teuthology.orchestra.run.trial070:osd.9> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.9.service 2026-02-13T03:44:48.711 INFO:tasks.cephadm:Deploying osd.10 on trial127 with /dev/vg_nvme/lv_1... 2026-02-13T03:44:48.712 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T03:44:48.831 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.b/config 2026-02-13T03:44:48.989 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T03:44:48.989 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.989 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.989 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:48.989 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:48.989 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.989 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:48.989 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:48.990 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:48.990 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T03:44:48.990 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:48.990 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:48.990 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:48.990 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:48 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.260 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-13T03:44:49.279 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial127:vg_nvme/lv_1 --skip-validation 2026-02-13T03:44:49.293 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T03:44:49.293 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:49.294 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.295 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:48 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.398 INFO:teuthology.orchestra.run.trial127.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.b/config 2026-02-13T03:44:49.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:49.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:49.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:48 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:49.514 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.510+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/2146158342 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e781109f0 msgr2=0x7f8e78171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:49.514 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.510+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/2146158342 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e781109f0 0x7f8e78171380 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=16786167104516168426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e7400aa40 tx=0x7f8e7402fde0 comp rx=0 tx=0).stop 2026-02-13T03:44:49.514 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.510+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/2146158342 shutdown_connections 2026-02-13T03:44:49.514 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.510+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/2146158342 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e781109f0 0x7f8e78171380 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=16786167104516168426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.510+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/2146158342 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8e78110040 0x7f8e781104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.510+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/2146158342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e7810eec0 0x7f8e7810f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.510+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/2146158342 >> 10.20.193.127:0/2146158342 conn(0x7f8e780ec5c0 msgr2=0x7f8e7810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.510+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/2146158342 shutdown_connections 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.510+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/2146158342 wait complete. 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 Processor -- start 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 -- start start 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e7810eec0 0x7f8e780f8600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e78110040 0x7f8e78171360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8e781109f0 0x7f8e780f8e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:49.515 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e780f9a90 con 0x7f8e781109f0 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8e780f9c00 con 0x7f8e7810eec0 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8e780f9dc0 con 0x7f8e78110040 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7d7416c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e7810eec0 0x7f8e780f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7d7416c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e7810eec0 0x7f8e780f8600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.127:58426/0 (socket says 10.20.193.127:58426) 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7d7416c0 1 -- 10.20.193.127:0/475994792 learned_addr learned my addr 10.20.193.127:0/475994792 (peer_addr_for_me v2:10.20.193.127:0/0) 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7cf406c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e78110040 0x7f8e78171360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7df426c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8e781109f0 0x7f8e780f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7d7416c0 1 -- 10.20.193.127:0/475994792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e78110040 msgr2=0x7f8e78171360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7d7416c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e78110040 0x7f8e78171360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7d7416c0 1 -- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8e781109f0 msgr2=0x7f8e780f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:49.516 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7d7416c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8e781109f0 0x7f8e780f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:49.517 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7d7416c0 1 -- 10.20.193.127:0/475994792 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7400a660 con 0x7f8e7810eec0 2026-02-13T03:44:49.517 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7d7416c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e7810eec0 0x7f8e780f8600 secure :-1 s=READY pgs=34 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e68005dc0 tx=0x7f8e6800bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:49.517 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e667fc6c0 1 -- 10.20.193.127:0/475994792 <== mon.2 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e68004250 con 0x7f8e7810eec0 2026-02-13T03:44:49.517 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e667fc6c0 1 -- 10.20.193.127:0/475994792 <== mon.2 v2:10.20.193.127:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8e68009070 con 0x7f8e7810eec0 2026-02-13T03:44:49.517 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e780fa040 con 0x7f8e7810eec0 2026-02-13T03:44:49.517 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e667fc6c0 1 -- 10.20.193.127:0/475994792 <== mon.2 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e6800cd70 con 0x7f8e7810eec0 2026-02-13T03:44:49.517 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.511+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e780fa520 con 0x7f8e7810eec0 2026-02-13T03:44:49.517 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.512+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e781752e0 con 0x7f8e7810eec0 2026-02-13T03:44:49.518 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.513+0000 7f8e667fc6c0 1 -- 10.20.193.127:0/475994792 <== mon.2 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f8e680028c0 con 0x7f8e7810eec0 2026-02-13T03:44:49.518 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.514+0000 7f8e667fc6c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8e540b5680 0x7f8e540d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:49.518 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.514+0000 7f8e667fc6c0 1 -- 10.20.193.127:0/475994792 <== mon.2 v2:10.20.193.127:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5742+0+0 (secure 0 0 0) 0x7f8e680e3070 con 0x7f8e7810eec0 2026-02-13T03:44:49.519 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.514+0000 7f8e7cf406c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8e540b5680 0x7f8e540d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:49.519 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.515+0000 7f8e7cf406c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8e540b5680 0x7f8e540d5b30 secure :-1 s=READY pgs=128 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e6c004750 tx=0x7f8e6c009190 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:49.519 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.515+0000 7f8e667fc6c0 1 -- 10.20.193.127:0/475994792 <== mon.2 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8e680a63e0 con 0x7f8e7810eec0 2026-02-13T03:44:49.613 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:49.612+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f8e7804ca20 con 0x7f8e540b5680 2026-02-13T03:44:50.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 174 KiB/s, 0 objects/s recovering 2026-02-13T03:44:50.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 145 KiB/s, 0 objects/s recovering 2026-02-13T03:44:50.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:50.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T03:44:50.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T03:44:50.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:44:50.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:50.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:50.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:50.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:50.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:50.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:49 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:50.162 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 174 KiB/s, 0 objects/s recovering 2026-02-13T03:44:50.162 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 145 KiB/s, 0 objects/s recovering 2026-02-13T03:44:50.162 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:50.163 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:50.164 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:49 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:50.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: pgmap v135: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 174 KiB/s, 0 objects/s recovering 2026-02-13T03:44:50.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: pgmap v136: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail; 145 KiB/s, 0 objects/s recovering 2026-02-13T03:44:50.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:50.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T03:44:50.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T03:44:50.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial070", "root=default"]} : dispatch 2026-02-13T03:44:50.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:50.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:50.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:50.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:50.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:50.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:50.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:49 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:50.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:44:50 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:44:50.277+0000 7f717821f6c0 -1 osd.9 0 waiting for initial osdmap 2026-02-13T03:44:50.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:44:50 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:44:50.283+0000 7f71700db6c0 -1 osd.9 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:44:51.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:51.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 150 KiB/s, 0 objects/s recovering 2026-02-13T03:44:51.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:44:51.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T03:44:51.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:51.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:51.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ca6791a-ad2b-4701-a67d-17e83888b9e7"} : dispatch 2026-02-13T03:44:51.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='client.? 10.20.193.127:0/2229123702' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ca6791a-ad2b-4701-a67d-17e83888b9e7"} : dispatch 2026-02-13T03:44:51.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ca6791a-ad2b-4701-a67d-17e83888b9e7"}]': finished 2026-02-13T03:44:51.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] boot 2026-02-13T03:44:51.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: osdmap e54: 11 total, 10 up, 11 in 2026-02-13T03:44:51.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:51.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:51.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: from='client.? 10.20.193.127:0/2737054583' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:51.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:51.300 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:50 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:51.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:51.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 150 KiB/s, 0 objects/s recovering 2026-02-13T03:44:51.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:44:51.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T03:44:51.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:51.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:51.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ca6791a-ad2b-4701-a67d-17e83888b9e7"} : dispatch 2026-02-13T03:44:51.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='client.? 10.20.193.127:0/2229123702' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ca6791a-ad2b-4701-a67d-17e83888b9e7"} : dispatch 2026-02-13T03:44:51.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ca6791a-ad2b-4701-a67d-17e83888b9e7"}]': finished 2026-02-13T03:44:51.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] boot 2026-02-13T03:44:51.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: osdmap e54: 11 total, 10 up, 11 in 2026-02-13T03:44:51.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:51.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:51.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: from='client.? 10.20.193.127:0/2737054583' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:51.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:51.454 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:50 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial127:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 150 KiB/s, 0 objects/s recovering 2026-02-13T03:44:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial070", "root=default"]}]': finished 2026-02-13T03:44:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T03:44:51.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ca6791a-ad2b-4701-a67d-17e83888b9e7"} : dispatch 2026-02-13T03:44:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='client.? 10.20.193.127:0/2229123702' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3ca6791a-ad2b-4701-a67d-17e83888b9e7"} : dispatch 2026-02-13T03:44:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ca6791a-ad2b-4701-a67d-17e83888b9e7"}]': finished 2026-02-13T03:44:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: osd.9 [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] boot 2026-02-13T03:44:51.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: osdmap e54: 11 total, 10 up, 11 in 2026-02-13T03:44:51.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T03:44:51.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:51.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: from='client.? 10.20.193.127:0/2737054583' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:51.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:51.476 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:50 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:52.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:44:52.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:44:52.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: osdmap e55: 11 total, 10 up, 11 in 2026-02-13T03:44:52.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:52.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:52.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:52.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:52.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:52.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:52.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:52.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:52.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:52.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:52 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:52.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:44:52.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:44:52.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: osdmap e55: 11 total, 10 up, 11 in 2026-02-13T03:44:52.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:52.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:52.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:52.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:52.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:52.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:52.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:52.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:52.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:52.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:52 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:52.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:44:52.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:44:52.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: osdmap e55: 11 total, 10 up, 11 in 2026-02-13T03:44:52.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:52.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:52.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:52.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:52.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:52.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:52.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:52.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:52.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:52.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:52 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:53.582 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:53 trial127 ceph-mon[26439]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:53.582 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:53 trial127 ceph-mon[26439]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:53.582 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:53 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:53.582 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:53 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T03:44:53.582 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:53 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:53.582 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:53 trial127 ceph-mon[26439]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:53.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:53 trial177 ceph-mon[27082]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:53.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:53 trial177 ceph-mon[27082]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:53.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:53 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:53.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:53 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T03:44:53.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:53 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:53.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:53 trial177 ceph-mon[27082]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:53.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:53 trial070 ceph-mon[24757]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:53.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:53 trial070 ceph-mon[24757]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:53.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:53 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:53.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:53 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T03:44:53.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:53 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:53.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:53 trial070 ceph-mon[24757]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:54.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:54 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:54.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:54 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:54.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:54 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:55.542 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:55 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:55.542 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:55 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:55.542 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:55 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:55.543 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:55 trial127 ceph-mon[26439]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:55.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:55 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:55.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:55 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:55.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:55 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:55.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:55 trial177 ceph-mon[27082]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:55.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:55 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:55.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:55 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:55.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:55 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:55.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:55 trial070 ceph-mon[24757]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:56.082 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.081+0000 7f8e667fc6c0 1 -- 10.20.193.127:0/475994792 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8e7804ca20 con 0x7f8e540b5680 2026-02-13T03:44:56.083 INFO:teuthology.orchestra.run.trial127.stdout:Created osd(s) 10 on host 'trial127' 2026-02-13T03:44:56.085 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8e540b5680 msgr2=0x7f8e540d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:56.085 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8e540b5680 0x7f8e540d5b30 secure :-1 s=READY pgs=128 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e6c004750 tx=0x7f8e6c009190 comp rx=0 tx=0).stop 2026-02-13T03:44:56.085 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e7810eec0 msgr2=0x7f8e780f8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:56.085 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e7810eec0 0x7f8e780f8600 secure :-1 s=READY pgs=34 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e68005dc0 tx=0x7f8e6800bbb0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.086 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 shutdown_connections 2026-02-13T03:44:56.086 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8e540b5680 0x7f8e540d5b30 unknown :-1 s=CLOSED pgs=128 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.086 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8e781109f0 0x7f8e780f8e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.086 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e78110040 0x7f8e78171360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.086 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 --2- 10.20.193.127:0/475994792 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8e7810eec0 0x7f8e780f8600 unknown :-1 s=CLOSED pgs=34 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.086 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 >> 10.20.193.127:0/475994792 conn(0x7f8e780ec5c0 msgr2=0x7f8e780eebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:56.086 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 shutdown_connections 2026-02-13T03:44:56.086 INFO:teuthology.orchestra.run.trial127.stderr:2026-02-13T03:44:56.083+0000 7f8e7f9d06c0 1 -- 10.20.193.127:0/475994792 wait complete. 2026-02-13T03:44:56.126 DEBUG:teuthology.orchestra.run.trial127:osd.10> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.10.service 2026-02-13T03:44:56.129 INFO:tasks.cephadm:Deploying osd.11 on trial177 with /dev/vg_nvme/lv_1... 2026-02-13T03:44:56.129 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T03:44:56.253 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:44:56.695 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-13T03:44:56.712 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch daemon add osd trial177:vg_nvme/lv_1 --skip-validation 2026-02-13T03:44:56.834 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:44:56.949 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.949 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.949 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:56.949 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:56.949 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.949 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='osd.10 [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.950 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:56 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:56.956 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.951+0000 7f193632c6c0 1 -- 10.20.193.177:0/1692709314 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010ddd0 msgr2=0x7f193010e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:56.956 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 --2- 10.20.193.177:0/1692709314 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010ddd0 0x7f193010e240 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=7911628530046565100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1920009970 tx=0x7f192002ed20 comp rx=0 tx=0).stop 2026-02-13T03:44:56.956 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 -- 10.20.193.177:0/1692709314 shutdown_connections 2026-02-13T03:44:56.956 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 --2- 10.20.193.177:0/1692709314 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f193010e780 0x7f193016f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 --2- 10.20.193.177:0/1692709314 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010ddd0 0x7f193010e240 unknown :-1 s=CLOSED pgs=36 gs=1 cs=0 l=1 c_cookie=7911628530046565100 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 --2- 10.20.193.177:0/1692709314 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f193010cc50 0x7f193010d040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 -- 10.20.193.177:0/1692709314 >> 10.20.193.177:0/1692709314 conn(0x7f19300ea370 msgr2=0x7f193010a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 -- 10.20.193.177:0/1692709314 shutdown_connections 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 -- 10.20.193.177:0/1692709314 wait complete. 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 Processor -- start 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 -- start start 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f193010cc50 0x7f19300f8620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f193010ddd0 0x7f193016f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:56.957 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010e780 0x7f19300f8e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f19300f9ab0 con 0x7f193010cc50 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f19300f9c20 con 0x7f193010ddd0 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f193632c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19300f9de0 con 0x7f193010e780 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f19348a26c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010e780 0x7f19300f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f19348a26c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010e780 0x7f19300f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:48478/0 (socket says 10.20.193.177:48478) 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f19348a26c0 1 -- 10.20.193.177:0/640522245 learned_addr learned my addr 10.20.193.177:0/640522245 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f192ffff6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f193010cc50 0x7f19300f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f192f7fe6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f193010ddd0 0x7f193016f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f19348a26c0 1 -- 10.20.193.177:0/640522245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f193010ddd0 msgr2=0x7f193016f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f19348a26c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f193010ddd0 0x7f193016f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f19348a26c0 1 -- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f193010cc50 msgr2=0x7f19300f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:44:56.958 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f19348a26c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f193010cc50 0x7f19300f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:44:56.959 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f19348a26c0 1 -- 10.20.193.177:0/640522245 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1920009590 con 0x7f193010e780 2026-02-13T03:44:56.959 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.952+0000 7f19348a26c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010e780 0x7f19300f8e80 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f192400c6c0 tx=0x7f192400cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:56.959 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.953+0000 7f192d7fa6c0 1 -- 10.20.193.177:0/640522245 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1924003c40 con 0x7f193010e780 2026-02-13T03:44:56.959 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.953+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19300fa0c0 con 0x7f193010e780 2026-02-13T03:44:56.959 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.953+0000 7f192d7fa6c0 1 -- 10.20.193.177:0/640522245 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f192400a030 con 0x7f193010e780 2026-02-13T03:44:56.959 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.953+0000 7f192d7fa6c0 1 -- 10.20.193.177:0/640522245 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f192400db70 con 0x7f193010e780 2026-02-13T03:44:56.959 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.953+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19300fa550 con 0x7f193010e780 2026-02-13T03:44:56.959 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.953+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1930172ff0 con 0x7f193010e780 2026-02-13T03:44:56.960 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.954+0000 7f192d7fa6c0 1 -- 10.20.193.177:0/640522245 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f192400dd20 con 0x7f193010e780 2026-02-13T03:44:56.960 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.955+0000 7f192d7fa6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19040b5600 0x7f19040d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:44:56.960 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.955+0000 7f192d7fa6c0 1 -- 10.20.193.177:0/640522245 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6175+0+0 (secure 0 0 0) 0x7f19240e4180 con 0x7f193010e780 2026-02-13T03:44:56.960 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.955+0000 7f192ffff6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19040b5600 0x7f19040d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:44:56.961 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.955+0000 7f192d7fa6c0 1 -- 10.20.193.177:0/640522245 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f19240a7340 con 0x7f193010e780 2026-02-13T03:44:56.961 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:56.956+0000 7f192ffff6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19040b5600 0x7f19040d5ab0 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f191c004750 tx=0x7f191c009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:44:56.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='osd.10 [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:56.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:56.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:56 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:57.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='osd.10 [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T03:44:57.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:57.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:57.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:56 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:44:57.053 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:44:57.050+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f1930061dd0 con 0x7f19040b5600 2026-02-13T03:44:57.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:57.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T03:44:57.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: osdmap e56: 11 total, 10 up, 11 in 2026-02-13T03:44:57.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:57.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:57.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='osd.10 [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:57.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:57.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:57.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:57.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:57.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:57.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:57.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:57 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:57.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:44:57 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:44:57.714+0000 7ffa052326c0 -1 osd.10 0 waiting for initial osdmap 2026-02-13T03:44:57.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:44:57 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:44:57.720+0000 7ffa010f66c0 -1 osd.10 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:44:57.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:57.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T03:44:57.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: osdmap e56: 11 total, 10 up, 11 in 2026-02-13T03:44:57.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:57.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:57.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='osd.10 [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:57.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:57.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:57.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:57.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:57.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:57.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:57.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:57.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:57 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:58.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:58.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T03:44:58.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: osdmap e56: 11 total, 10 up, 11 in 2026-02-13T03:44:58.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:58.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:58.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='osd.10 [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial127", "root=default"]} : dispatch 2026-02-13T03:44:58.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:44:58.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:58.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:58.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:58.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:44:58.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:44:58.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:44:58.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:44:58.050 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:57 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:44:58.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: osdmap e57: 11 total, 10 up, 11 in 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: from='client.? 10.20.193.177:0/2777822821' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d51bb23-8f23-43b5-b697-ca294fd39e89"} : dispatch 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d51bb23-8f23-43b5-b697-ca294fd39e89"} : dispatch 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d51bb23-8f23-43b5-b697-ca294fd39e89"}]': finished 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: osd.10 [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] boot 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: osdmap e58: 12 total, 11 up, 12 in 2026-02-13T03:44:58.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:58.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:44:58.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: from='client.? 10.20.193.177:0/3942868616' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:58.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:58.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:58 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:44:59.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: osdmap e57: 11 total, 10 up, 11 in 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/2777822821' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d51bb23-8f23-43b5-b697-ca294fd39e89"} : dispatch 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d51bb23-8f23-43b5-b697-ca294fd39e89"} : dispatch 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d51bb23-8f23-43b5-b697-ca294fd39e89"}]': finished 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: osd.10 [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] boot 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: osdmap e58: 12 total, 11 up, 12 in 2026-02-13T03:44:59.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:59.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:44:59.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: from='client.? 10.20.193.177:0/3942868616' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:59.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:59.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:58 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:44:59.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T03:44:59.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial127", "root=default"]}]': finished 2026-02-13T03:44:59.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: osdmap e57: 11 total, 10 up, 11 in 2026-02-13T03:44:59.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:59.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:59.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/2777822821' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d51bb23-8f23-43b5-b697-ca294fd39e89"} : dispatch 2026-02-13T03:44:59.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d51bb23-8f23-43b5-b697-ca294fd39e89"} : dispatch 2026-02-13T03:44:59.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d51bb23-8f23-43b5-b697-ca294fd39e89"}]': finished 2026-02-13T03:44:59.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: osd.10 [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] boot 2026-02-13T03:44:59.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: osdmap e58: 12 total, 11 up, 12 in 2026-02-13T03:44:59.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T03:44:59.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:44:59.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: from='client.? 10.20.193.177:0/3942868616' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:44:59.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:44:59.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:58 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:45:00.112 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:45:00.112 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:45:00.112 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: osdmap e59: 12 total, 11 up, 12 in 2026-02-13T03:45:00.112 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:00.112 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:00.112 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:00.112 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:00.112 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:00.113 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:00.113 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:00.113 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:00.113 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:00.113 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:44:59 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:00.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:45:00.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: osdmap e59: 12 total, 11 up, 12 in 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:00.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:44:59 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:00.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: osdmap e59: 12 total, 11 up, 12 in 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:00.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:00.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:44:59 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:00 trial177 ceph-mon[27082]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:00 trial177 ceph-mon[27082]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:00 trial177 ceph-mon[27082]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:00 trial177 ceph-mon[27082]: osdmap e60: 12 total, 11 up, 12 in 2026-02-13T03:45:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T03:45:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:00 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:01.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:00 trial127 ceph-mon[26439]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:01.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:00 trial127 ceph-mon[26439]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:01.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:00 trial127 ceph-mon[26439]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:01.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:00 trial127 ceph-mon[26439]: osdmap e60: 12 total, 11 up, 12 in 2026-02-13T03:45:01.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:01.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T03:45:01.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:00 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:01.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:00 trial070 ceph-mon[24757]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:01.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:00 trial070 ceph-mon[24757]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:01.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:00 trial070 ceph-mon[24757]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:01.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:00 trial070 ceph-mon[24757]: osdmap e60: 12 total, 11 up, 12 in 2026-02-13T03:45:01.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:01.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T03:45:01.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:00 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:02.199 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:01 trial177 ceph-mon[27082]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:02.199 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:01 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:45:02.199 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:01 trial177 ceph-mon[27082]: osdmap e61: 12 total, 11 up, 12 in 2026-02-13T03:45:02.199 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:01 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:02.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:01 trial127 ceph-mon[26439]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:02.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:01 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:45:02.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:01 trial127 ceph-mon[26439]: osdmap e61: 12 total, 11 up, 12 in 2026-02-13T03:45:02.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:01 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:02.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:01 trial070 ceph-mon[24757]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:02.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:01 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:45:02.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:01 trial070 ceph-mon[24757]: osdmap e61: 12 total, 11 up, 12 in 2026-02-13T03:45:02.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:01 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:02.920 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:02 trial177 ceph-mon[27082]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T03:45:02.920 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:02.920 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:02.920 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:02.920 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:03.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:02 trial127 ceph-mon[26439]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T03:45:03.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:03.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:03.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:03.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:03.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:02 trial070 ceph-mon[24757]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T03:45:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:03.520 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.518+0000 7f192d7fa6c0 1 -- 10.20.193.177:0/640522245 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1930061dd0 con 0x7f19040b5600 2026-02-13T03:45:03.521 INFO:teuthology.orchestra.run.trial177.stdout:Created osd(s) 11 on host 'trial177' 2026-02-13T03:45:03.523 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19040b5600 msgr2=0x7f19040d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:03.523 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19040b5600 0x7f19040d5ab0 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f191c004750 tx=0x7f191c009390 comp rx=0 tx=0).stop 2026-02-13T03:45:03.523 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010e780 msgr2=0x7f19300f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:03.523 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010e780 0x7f19300f8e80 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f192400c6c0 tx=0x7f192400cb90 comp rx=0 tx=0).stop 2026-02-13T03:45:03.523 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 shutdown_connections 2026-02-13T03:45:03.523 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19040b5600 0x7f19040d5ab0 unknown :-1 s=CLOSED pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.523 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f193010e780 0x7f19300f8e80 unknown :-1 s=CLOSED pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.523 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f193010ddd0 0x7f193016f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.523 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 --2- 10.20.193.177:0/640522245 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f193010cc50 0x7f19300f8620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.524 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 >> 10.20.193.177:0/640522245 conn(0x7f19300ea370 msgr2=0x7f19300616c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:03.524 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 shutdown_connections 2026-02-13T03:45:03.524 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:03.520+0000 7f193632c6c0 1 -- 10.20.193.177:0/640522245 wait complete. 2026-02-13T03:45:03.564 DEBUG:teuthology.orchestra.run.trial177:osd.11> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.11.service 2026-02-13T03:45:03.566 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-13T03:45:03.566 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T03:45:03.686 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:03.804 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.800+0000 7f9127f606c0 1 -- 10.20.193.70:0/1481335561 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9120110040 msgr2=0x7f91201104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:03.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.800+0000 7f9127f606c0 1 --2- 10.20.193.70:0/1481335561 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9120110040 0x7f91201104b0 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=12382329818718152443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9114009970 tx=0x7f911402ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:03.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.800+0000 7f9127f606c0 1 -- 10.20.193.70:0/1481335561 shutdown_connections 2026-02-13T03:45:03.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.800+0000 7f9127f606c0 1 --2- 10.20.193.70:0/1481335561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91201109f0 0x7f9120171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.800+0000 7f9127f606c0 1 --2- 10.20.193.70:0/1481335561 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9120110040 0x7f91201104b0 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=12382329818718152443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.800+0000 7f9127f606c0 1 --2- 10.20.193.70:0/1481335561 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f912010eec0 0x7f912010f2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.800+0000 7f9127f606c0 1 -- 10.20.193.70:0/1481335561 >> 10.20.193.70:0/1481335561 conn(0x7f91200ec5c0 msgr2=0x7f912010c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:03.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.800+0000 7f9127f606c0 1 -- 10.20.193.70:0/1481335561 shutdown_connections 2026-02-13T03:45:03.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.800+0000 7f9127f606c0 1 -- 10.20.193.70:0/1481335561 wait complete. 2026-02-13T03:45:03.805 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 Processor -- start 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 -- start start 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f912010eec0 0x7f91200f8640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9120110040 0x7f9120171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91201109f0 0x7f91200f8ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91200f9ad0 con 0x7f91201109f0 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f91200f9c40 con 0x7f9120110040 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91200f9e00 con 0x7f912010eec0 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f91264d26c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91201109f0 0x7f91200f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f91264d26c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91201109f0 0x7f91200f8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:42460/0 (socket says 10.20.193.70:42460) 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f91264d26c0 1 -- 10.20.193.70:0/2548426389 learned_addr learned my addr 10.20.193.70:0/2548426389 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:03.806 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9125cd16c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f912010eec0 0x7f91200f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f91264d26c0 1 -- 10.20.193.70:0/2548426389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f912010eec0 msgr2=0x7f91200f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f91264d26c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f912010eec0 0x7f91200f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f91264d26c0 1 -- 10.20.193.70:0/2548426389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9120110040 msgr2=0x7f9120171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f91264d26c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9120110040 0x7f9120171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f91264d26c0 1 -- 10.20.193.70:0/2548426389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9114009590 con 0x7f91201109f0 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f91264d26c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91201109f0 0x7f91200f8ea0 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f911c00c6c0 tx=0x7f911c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f910effd6c0 1 -- 10.20.193.70:0/2548426389 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f911c003a30 con 0x7f91201109f0 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91200fa0e0 con 0x7f91201109f0 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f910effd6c0 1 -- 10.20.193.70:0/2548426389 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f911c0054e0 con 0x7f91201109f0 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f910effd6c0 1 -- 10.20.193.70:0/2548426389 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f911c00dc50 con 0x7f91201109f0 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.801+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91200fa5c0 con 0x7f91201109f0 2026-02-13T03:45:03.807 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.802+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91201752c0 con 0x7f91201109f0 2026-02-13T03:45:03.808 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.803+0000 7f910effd6c0 1 -- 10.20.193.70:0/2548426389 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f911c005080 con 0x7f91201109f0 2026-02-13T03:45:03.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.804+0000 7f910effd6c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90fc0b5600 0x7f90fc0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:03.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.804+0000 7f9125cd16c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90fc0b5600 0x7f90fc0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:03.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.804+0000 7f910effd6c0 1 -- 10.20.193.70:0/2548426389 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6586+0+0 (secure 0 0 0) 0x7f911c0e43d0 con 0x7f91201109f0 2026-02-13T03:45:03.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.804+0000 7f9125cd16c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90fc0b5600 0x7f90fc0d5ab0 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9110005980 tx=0x7f9110005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:03.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.804+0000 7f910effd6c0 1 -- 10.20.193.70:0/2548426389 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f911c0a7430 con 0x7f91201109f0 2026-02-13T03:45:03.901 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.899+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9120174960 con 0x7f91201109f0 2026-02-13T03:45:03.901 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.899+0000 7f910effd6c0 1 -- 10.20.193.70:0/2548426389 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v62) ==== 74+0+133 (secure 0 0 0) 0x7f911c00de60 con 0x7f91201109f0 2026-02-13T03:45:03.901 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:03.902 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90fc0b5600 msgr2=0x7f90fc0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:03.902 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90fc0b5600 0x7f90fc0d5ab0 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9110005980 tx=0x7f9110005910 comp rx=0 tx=0).stop 2026-02-13T03:45:03.902 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91201109f0 msgr2=0x7f91200f8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:03.903 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91201109f0 0x7f91200f8ea0 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f911c00c6c0 tx=0x7f911c00cb90 comp rx=0 tx=0).stop 2026-02-13T03:45:03.903 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 shutdown_connections 2026-02-13T03:45:03.903 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90fc0b5600 0x7f90fc0d5ab0 unknown :-1 s=CLOSED pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.903 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91201109f0 0x7f91200f8ea0 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.903 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9120110040 0x7f9120171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.903 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 --2- 10.20.193.70:0/2548426389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f912010eec0 0x7f91200f8640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:03.903 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 >> 10.20.193.70:0/2548426389 conn(0x7f91200ec5c0 msgr2=0x7f91200eec00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:03.903 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 shutdown_connections 2026-02-13T03:45:03.903 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:03.901+0000 7f9127f606c0 1 -- 10.20.193.70:0/2548426389 wait complete. 2026-02-13T03:45:03.945 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":62,"num_osds":12,"num_up_osds":11,"osd_up_since":1770954297,"num_in_osds":12,"osd_in_since":1770954297,"num_remapped_pgs":0} 2026-02-13T03:45:04.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T03:45:04.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:04.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: pgmap v162: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 174 KiB/s, 0 objects/s recovering 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='osd.11 [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:04 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2548426389' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:45:04.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: pgmap v162: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 174 KiB/s, 0 objects/s recovering 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='osd.11 [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:04 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2548426389' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: pgmap v162: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 174 KiB/s, 0 objects/s recovering 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='osd.11 [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:04 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2548426389' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:45:04.946 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T03:45:05.064 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:05.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.176+0000 7f15add286c0 1 -- 10.20.193.70:0/3307893931 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110050 msgr2=0x7f15a81104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:05.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.176+0000 7f15add286c0 1 --2- 10.20.193.70:0/3307893931 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110050 0x7f15a81104c0 secure :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=2943298201388172675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1598009970 tx=0x7f159802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:05.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.176+0000 7f15add286c0 1 -- 10.20.193.70:0/3307893931 shutdown_connections 2026-02-13T03:45:05.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.176+0000 7f15add286c0 1 --2- 10.20.193.70:0/3307893931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a8110a00 0x7f15a8171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.176+0000 7f15add286c0 1 --2- 10.20.193.70:0/3307893931 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110050 0x7f15a81104c0 unknown :-1 s=CLOSED pgs=186 gs=1 cs=0 l=1 c_cookie=2943298201388172675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.176+0000 7f15add286c0 1 --2- 10.20.193.70:0/3307893931 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15a810eed0 0x7f15a810f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.176+0000 7f15add286c0 1 -- 10.20.193.70:0/3307893931 >> 10.20.193.70:0/3307893931 conn(0x7f15a80ec5f0 msgr2=0x7f15a810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:05.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.176+0000 7f15add286c0 1 -- 10.20.193.70:0/3307893931 shutdown_connections 2026-02-13T03:45:05.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.176+0000 7f15add286c0 1 -- 10.20.193.70:0/3307893931 wait complete. 2026-02-13T03:45:05.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 Processor -- start 2026-02-13T03:45:05.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 -- start start 2026-02-13T03:45:05.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a810eed0 0x7f15a80f86b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:05.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15a8110050 0x7f15a8171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110a00 0x7f15a80f8f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15a80f9b40 con 0x7f15a8110a00 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f15a80f9cb0 con 0x7f15a8110050 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15a80f9e70 con 0x7f15a810eed0 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a7fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110a00 0x7f15a80f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a7fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110a00 0x7f15a80f8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:42466/0 (socket says 10.20.193.70:42466) 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a7fff6c0 1 -- 10.20.193.70:0/19411894 learned_addr learned my addr 10.20.193.70:0/19411894 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a6ffd6c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15a8110050 0x7f15a8171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a77fe6c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a810eed0 0x7f15a80f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a7fff6c0 1 -- 10.20.193.70:0/19411894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a810eed0 msgr2=0x7f15a80f86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a7fff6c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a810eed0 0x7f15a80f86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a7fff6c0 1 -- 10.20.193.70:0/19411894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15a8110050 msgr2=0x7f15a8171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a7fff6c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15a8110050 0x7f15a8171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a7fff6c0 1 -- 10.20.193.70:0/19411894 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1598009590 con 0x7f15a8110a00 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a6ffd6c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15a8110050 0x7f15a8171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a7fff6c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110a00 0x7f15a80f8f10 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f159c006ea0 tx=0x7f159c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a4ff96c0 1 -- 10.20.193.70:0/19411894 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f159c003a30 con 0x7f15a8110a00 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a80fa150 con 0x7f15a8110a00 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a4ff96c0 1 -- 10.20.193.70:0/19411894 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f159c0054f0 con 0x7f15a8110a00 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15a4ff96c0 1 -- 10.20.193.70:0/19411894 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f159c00dcd0 con 0x7f15a8110a00 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.177+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a80fa680 con 0x7f15a8110a00 2026-02-13T03:45:05.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.178+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a81752a0 con 0x7f15a8110a00 2026-02-13T03:45:05.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.179+0000 7f15a4ff96c0 1 -- 10.20.193.70:0/19411894 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f159c005030 con 0x7f15a8110a00 2026-02-13T03:45:05.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.180+0000 7f15a4ff96c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f157c0b5600 0x7f157c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:05.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.180+0000 7f15a77fe6c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f157c0b5600 0x7f157c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:05.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.180+0000 7f15a4ff96c0 1 -- 10.20.193.70:0/19411894 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6624+0+0 (secure 0 0 0) 0x7f159c0e45a0 con 0x7f15a8110a00 2026-02-13T03:45:05.182 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.180+0000 7f15a77fe6c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f157c0b5600 0x7f157c0d5ab0 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1594005980 tx=0x7f1594005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:05.182 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.180+0000 7f15a4ff96c0 1 -- 10.20.193.70:0/19411894 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f159c0a75c0 con 0x7f15a8110a00 2026-02-13T03:45:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: pgmap v163: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 146 KiB/s, 0 objects/s recovering 2026-02-13T03:45:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T03:45:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T03:45:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='osd.11 [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:45:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:45:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:05.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:05 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:05.202 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:45:05 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:45:05.143+0000 7f37de5886c0 -1 osd.11 0 waiting for initial osdmap 2026-02-13T03:45:05.202 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:45:05 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:45:05.150+0000 7f37da44c6c0 -1 osd.11 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:45:05.277 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.275+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f15a8174940 con 0x7f15a8110a00 2026-02-13T03:45:05.277 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.275+0000 7f15a4ff96c0 1 -- 10.20.193.70:0/19411894 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7f159c00de60 con 0x7f15a8110a00 2026-02-13T03:45:05.277 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: pgmap v163: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 146 KiB/s, 0 objects/s recovering 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='osd.11 [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.277 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:05.278 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:05.278 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:05 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f157c0b5600 msgr2=0x7f157c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f157c0b5600 0x7f157c0d5ab0 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1594005980 tx=0x7f1594005910 comp rx=0 tx=0).stop 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110a00 msgr2=0x7f15a80f8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110a00 0x7f15a80f8f10 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f159c006ea0 tx=0x7f159c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 shutdown_connections 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f157c0b5600 0x7f157c0d5ab0 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15a8110a00 0x7f15a80f8f10 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15a8110050 0x7f15a8171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 --2- 10.20.193.70:0/19411894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a810eed0 0x7f15a80f86b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 >> 10.20.193.70:0/19411894 conn(0x7f15a80ec5f0 msgr2=0x7f15a80eeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 shutdown_connections 2026-02-13T03:45:05.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:05.276+0000 7f15add286c0 1 -- 10.20.193.70:0/19411894 wait complete. 2026-02-13T03:45:05.321 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1770954297,"num_in_osds":12,"osd_in_since":1770954297,"num_remapped_pgs":0} 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: pgmap v163: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail; 146 KiB/s, 0 objects/s recovering 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='osd.11 [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]} : dispatch 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T03:45:05.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:05.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:05.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:05.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:05.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:05.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:05 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:06.322 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T03:45:06.439 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:06.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:06 trial177 ceph-mon[27082]: pgmap v165: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 152 KiB/s, 0 objects/s recovering 2026-02-13T03:45:06.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:06 trial177 ceph-mon[27082]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:45:06.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:06 trial177 ceph-mon[27082]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T03:45:06.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:06.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:06 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:06.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:06 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/19411894' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:45:06.462 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:06 trial070 ceph-mon[24757]: pgmap v165: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 152 KiB/s, 0 objects/s recovering 2026-02-13T03:45:06.462 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:06 trial070 ceph-mon[24757]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:45:06.462 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:06 trial070 ceph-mon[24757]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T03:45:06.462 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:06.462 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:06 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:06.462 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:06 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/19411894' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:45:06.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:06 trial127 ceph-mon[26439]: pgmap v165: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 152 KiB/s, 0 objects/s recovering 2026-02-13T03:45:06.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:06 trial127 ceph-mon[26439]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-13T03:45:06.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:06 trial127 ceph-mon[26439]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T03:45:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:06 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:06.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:06 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/19411894' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:45:06.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 -- 10.20.193.70:0/2793908341 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 msgr2=0x7f5b8c171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:06.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 --2- 10.20.193.70:0/2793908341 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 0x7f5b8c171390 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=12845025314213822741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b8800aa40 tx=0x7f5b8802fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 -- 10.20.193.70:0/2793908341 shutdown_connections 2026-02-13T03:45:06.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 --2- 10.20.193.70:0/2793908341 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 0x7f5b8c171390 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=12845025314213822741 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 --2- 10.20.193.70:0/2793908341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b8c110050 0x7f5b8c1104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 --2- 10.20.193.70:0/2793908341 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5b8c10eed0 0x7f5b8c10f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 -- 10.20.193.70:0/2793908341 >> 10.20.193.70:0/2793908341 conn(0x7f5b8c0ec5f0 msgr2=0x7f5b8c10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:06.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 -- 10.20.193.70:0/2793908341 shutdown_connections 2026-02-13T03:45:06.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 -- 10.20.193.70:0/2793908341 wait complete. 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 Processor -- start 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 -- start start 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5b8c10eed0 0x7f5b8c0f85a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b8c110050 0x7f5b8c171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 0x7f5b8c0f8e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c0f9a30 con 0x7f5b8c110a00 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c0f9ba0 con 0x7f5b8c10eed0 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b931906c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c0f9d60 con 0x7f5b8c110050 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b917066c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 0x7f5b8c0f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b917066c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 0x7f5b8c0f8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:51910/0 (socket says 10.20.193.70:51910) 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.553+0000 7f5b917066c0 1 -- 10.20.193.70:0/3593781932 learned_addr learned my addr 10.20.193.70:0/3593781932 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:06.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b83fff6c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b8c110050 0x7f5b8c171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b90f056c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5b8c10eed0 0x7f5b8c0f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b917066c0 1 -- 10.20.193.70:0/3593781932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b8c110050 msgr2=0x7f5b8c171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b917066c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b8c110050 0x7f5b8c171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b917066c0 1 -- 10.20.193.70:0/3593781932 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5b8c10eed0 msgr2=0x7f5b8c0f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b917066c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5b8c10eed0 0x7f5b8c0f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b917066c0 1 -- 10.20.193.70:0/3593781932 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8800a660 con 0x7f5b8c110a00 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b917066c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 0x7f5b8c0f8e00 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b8800a390 tx=0x7f5b88005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b81ffb6c0 1 -- 10.20.193.70:0/3593781932 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b880057e0 con 0x7f5b8c110a00 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b81ffb6c0 1 -- 10.20.193.70:0/3593781932 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5b88003c40 con 0x7f5b8c110a00 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c0f9fe0 con 0x7f5b8c110a00 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b81ffb6c0 1 -- 10.20.193.70:0/3593781932 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b88038380 con 0x7f5b8c110a00 2026-02-13T03:45:06.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c0fa410 con 0x7f5b8c110a00 2026-02-13T03:45:06.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.554+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8c0fa630 con 0x7f5b8c110a00 2026-02-13T03:45:06.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.556+0000 7f5b81ffb6c0 1 -- 10.20.193.70:0/3593781932 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f5b88008260 con 0x7f5b8c110a00 2026-02-13T03:45:06.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.556+0000 7f5b81ffb6c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5b680b5600 0x7f5b680d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:06.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.556+0000 7f5b81ffb6c0 1 -- 10.20.193.70:0/3593781932 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6904+0+0 (secure 0 0 0) 0x7f5b88108a60 con 0x7f5b8c110a00 2026-02-13T03:45:06.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.556+0000 7f5b90f056c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5b680b5600 0x7f5b680d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:06.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.556+0000 7f5b81ffb6c0 1 -- 10.20.193.70:0/3593781932 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5b880ce910 con 0x7f5b8c110a00 2026-02-13T03:45:06.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.556+0000 7f5b90f056c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5b680b5600 0x7f5b680d5ab0 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b7c004750 tx=0x7f5b7c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:06.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.651+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5b8c10f2c0 con 0x7f5b8c110a00 2026-02-13T03:45:06.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.651+0000 7f5b81ffb6c0 1 -- 10.20.193.70:0/3593781932 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f5b880ceaf0 con 0x7f5b8c110a00 2026-02-13T03:45:06.654 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:06.655 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5b680b5600 msgr2=0x7f5b680d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:06.655 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5b680b5600 0x7f5b680d5ab0 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b7c004750 tx=0x7f5b7c009260 comp rx=0 tx=0).stop 2026-02-13T03:45:06.655 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 msgr2=0x7f5b8c0f8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:06.655 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 0x7f5b8c0f8e00 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b8800a390 tx=0x7f5b88005530 comp rx=0 tx=0).stop 2026-02-13T03:45:06.655 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 shutdown_connections 2026-02-13T03:45:06.655 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5b680b5600 0x7f5b680d5ab0 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.655 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5b8c110a00 0x7f5b8c0f8e00 unknown :-1 s=CLOSED pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.655 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b8c110050 0x7f5b8c171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.656 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 --2- 10.20.193.70:0/3593781932 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5b8c10eed0 0x7f5b8c0f85a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.656 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 >> 10.20.193.70:0/3593781932 conn(0x7f5b8c0ec5f0 msgr2=0x7f5b8c0eeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:06.656 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 shutdown_connections 2026-02-13T03:45:06.656 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.652+0000 7f5b931906c0 1 -- 10.20.193.70:0/3593781932 wait complete. 2026-02-13T03:45:06.695 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":65,"num_osds":12,"num_up_osds":12,"osd_up_since":1770954306,"num_in_osds":12,"osd_in_since":1770954297,"num_remapped_pgs":0} 2026-02-13T03:45:06.696 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:45:06.815 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:06.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.932+0000 7f91c723c6c0 1 -- 10.20.193.70:0/1982275445 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 msgr2=0x7f91c0175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:06.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.932+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/1982275445 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 0x7f91c0175de0 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=28927340061298798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91bc00aa70 tx=0x7f91bc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.932+0000 7f91c723c6c0 1 -- 10.20.193.70:0/1982275445 shutdown_connections 2026-02-13T03:45:06.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.932+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/1982275445 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 0x7f91c0175de0 unknown :-1 s=CLOSED pgs=190 gs=1 cs=0 l=1 c_cookie=28927340061298798 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.932+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/1982275445 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91c010fc20 0x7f91c0114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.932+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/1982275445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91c010f230 0x7f91c010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.932+0000 7f91c723c6c0 1 -- 10.20.193.70:0/1982275445 >> 10.20.193.70:0/1982275445 conn(0x7f91c00ecb30 msgr2=0x7f91c010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:06.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.932+0000 7f91c723c6c0 1 -- 10.20.193.70:0/1982275445 shutdown_connections 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 -- 10.20.193.70:0/1982275445 wait complete. 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 Processor -- start 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 -- start start 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91c010f230 0x7f91c011d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 0x7f91c011d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91c0122b00 0x7f91c0122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91c0123510 con 0x7f91c0115440 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f91c0123680 con 0x7f91c0122b00 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91c0123840 con 0x7f91c010f230 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b7fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 0x7f91c011d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b7fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 0x7f91c011d740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:51934/0 (socket says 10.20.193.70:51934) 2026-02-13T03:45:06.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b7fff6c0 1 -- 10.20.193.70:0/4218620045 learned_addr learned my addr 10.20.193.70:0/4218620045 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c57b26c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91c0122b00 0x7f91c0122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b7fff6c0 1 -- 10.20.193.70:0/4218620045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91c010f230 msgr2=0x7f91c011d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b7fff6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91c010f230 0x7f91c011d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b7fff6c0 1 -- 10.20.193.70:0/4218620045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91c0122b00 msgr2=0x7f91c0122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b7fff6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91c0122b00 0x7f91c0122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b7fff6c0 1 -- 10.20.193.70:0/4218620045 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc00a660 con 0x7f91c0115440 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b7fff6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 0x7f91c011d740 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91a800b800 tx=0x7f91a800bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b5ffb6c0 1 -- 10.20.193.70:0/4218620045 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91a8004a80 con 0x7f91c0115440 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c0163cf0 con 0x7f91c0115440 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b5ffb6c0 1 -- 10.20.193.70:0/4218620045 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f91a8009070 con 0x7f91c0115440 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91b5ffb6c0 1 -- 10.20.193.70:0/4218620045 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91a800cdd0 con 0x7f91c0115440 2026-02-13T03:45:06.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.933+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c0164180 con 0x7f91c0115440 2026-02-13T03:45:06.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.934+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c0110500 con 0x7f91c0115440 2026-02-13T03:45:06.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.935+0000 7f91b5ffb6c0 1 -- 10.20.193.70:0/4218620045 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f91a8004060 con 0x7f91c0115440 2026-02-13T03:45:06.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.936+0000 7f91b5ffb6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f919c0b5600 0x7f919c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:06.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.936+0000 7f91b5ffb6c0 1 -- 10.20.193.70:0/4218620045 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6904+0+0 (secure 0 0 0) 0x7f91a80e3640 con 0x7f91c0115440 2026-02-13T03:45:06.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.936+0000 7f91c4fb16c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f919c0b5600 0x7f919c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:06.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.936+0000 7f91b5ffb6c0 1 -- 10.20.193.70:0/4218620045 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f91a80a6560 con 0x7f91c0115440 2026-02-13T03:45:06.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:06.936+0000 7f91c4fb16c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f919c0b5600 0x7f919c0d5ab0 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91b0004750 tx=0x7f91b00096a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:07.031 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.029+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91c010fc20 con 0x7f91c0115440 2026-02-13T03:45:07.031 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.029+0000 7f91b5ffb6c0 1 -- 10.20.193.70:0/4218620045 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+18176 (secure 0 0 0) 0x7f91a80a9710 con 0x7f91c0115440 2026-02-13T03:45:07.032 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:07.032 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":65,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","created":"2026-02-13T03:42:55.979106+0000","modified":"2026-02-13T03:45:06.144024+0000","last_up_change":"2026-02-13T03:45:06.144024+0000","last_in_change":"2026-02-13T03:44:57.854565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:43:58.913146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76aee801-8323-41e6-8540-7d0b5fa666e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6802","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6803","nonce":1468748446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6804","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6805","nonce":1468748446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6808","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6809","nonce":1468748446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6806","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6807","nonce":1468748446}]},"public_addr":"10.20.193.70:6803/1468748446","cluster_addr":"10.20.193.70:6805/1468748446","heartbeat_back_addr":"10.20.193.70:6809/1468748446","heartbeat_front_addr":"10.20.193.70:6807/1468748446","state":["exists","up"]},{"osd":1,"uuid":"621ea3ce-4cd8-4150-a1ba-f4e189f680bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6801","nonce":3454251527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6803","nonce":3454251527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6807","nonce":3454251527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6805","nonce":3454251527}]},"public_addr":"10.20.193.127:6801/3454251527","cluster_addr":"10.20.193.127:6803/3454251527","heartbeat_back_addr":"10.20.193.127:6807/3454251527","heartbeat_front_addr":"10.20.193.127:6805/3454251527","state":["exists","up"]},{"osd":2,"uuid":"17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6801","nonce":2599066943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6803","nonce":2599066943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6807","nonce":2599066943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6805","nonce":2599066943}]},"public_addr":"10.20.193.177:6801/2599066943","cluster_addr":"10.20.193.177:6803/2599066943","heartbeat_back_addr":"10.20.193.177:6807/2599066943","heartbeat_front_addr":"10.20.193.177:6805/2599066943","state":["exists","up"]},{"osd":3,"uuid":"31edcb70-f683-4525-b2c3-348788484124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6810","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6811","nonce":3715748086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6812","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6813","nonce":3715748086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6816","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6817","nonce":3715748086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6814","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6815","nonce":3715748086}]},"public_addr":"10.20.193.70:6811/3715748086","cluster_addr":"10.20.193.70:6813/3715748086","heartbeat_back_addr":"10.20.193.70:6817/3715748086","heartbeat_front_addr":"10.20.193.70:6815/3715748086","state":["exists","up"]},{"osd":4,"uuid":"82a40ce4-8f67-4a58-b08d-d7bfdbd447ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6809","nonce":2954348410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6811","nonce":2954348410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6815","nonce":2954348410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6813","nonce":2954348410}]},"public_addr":"10.20.193.127:6809/2954348410","cluster_addr":"10.20.193.127:6811/2954348410","heartbeat_back_addr":"10.20.193.127:6815/2954348410","heartbeat_front_addr":"10.20.193.127:6813/2954348410","state":["exists","up"]},{"osd":5,"uuid":"f96cee85-6197-423b-a006-6d2d85772d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6809","nonce":2878984246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6811","nonce":2878984246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6815","nonce":2878984246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6813","nonce":2878984246}]},"public_addr":"10.20.193.177:6809/2878984246","cluster_addr":"10.20.193.177:6811/2878984246","heartbeat_back_addr":"10.20.193.177:6815/2878984246","heartbeat_front_addr":"10.20.193.177:6813/2878984246","state":["exists","up"]},{"osd":6,"uuid":"8703f159-2f0c-4744-8797-960d48eedfc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6818","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6819","nonce":192941608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6820","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6821","nonce":192941608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6824","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6825","nonce":192941608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6822","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6823","nonce":192941608}]},"public_addr":"10.20.193.70:6819/192941608","cluster_addr":"10.20.193.70:6821/192941608","heartbeat_back_addr":"10.20.193.70:6825/192941608","heartbeat_front_addr":"10.20.193.70:6823/192941608","state":["exists","up"]},{"osd":7,"uuid":"7203c134-bbbb-4980-b512-a49cb17481d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6817","nonce":3503194265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6819","nonce":3503194265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6823","nonce":3503194265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6821","nonce":3503194265}]},"public_addr":"10.20.193.127:6817/3503194265","cluster_addr":"10.20.193.127:6819/3503194265","heartbeat_back_addr":"10.20.193.127:6823/3503194265","heartbeat_front_addr":"10.20.193.127:6821/3503194265","state":["exists","up"]},{"osd":8,"uuid":"1771e760-778b-4f83-a0c5-12eeee43c768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6817","nonce":2623744285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6819","nonce":2623744285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6823","nonce":2623744285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6821","nonce":2623744285}]},"public_addr":"10.20.193.177:6817/2623744285","cluster_addr":"10.20.193.177:6819/2623744285","heartbeat_back_addr":"10.20.193.177:6823/2623744285","heartbeat_front_addr":"10.20.193.177:6821/2623744285","state":["exists","up"]},{"osd":9,"uuid":"2ad7ff96-14be-4cb9-9b52-1a00e064de38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6826","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6827","nonce":1992888403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6828","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6829","nonce":1992888403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6832","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6833","nonce":1992888403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6830","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6831","nonce":1992888403}]},"public_addr":"10.20.193.70:6827/1992888403","cluster_addr":"10.20.193.70:6829/1992888403","heartbeat_back_addr":"10.20.193.70:6833/1992888403","heartbeat_front_addr":"10.20.193.70:6831/1992888403","state":["exists","up"]},{"osd":10,"uuid":"3ca6791a-ad2b-4701-a67d-17e83888b9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6825","nonce":380098770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6827","nonce":380098770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6831","nonce":380098770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6829","nonce":380098770}]},"public_addr":"10.20.193.127:6825/380098770","cluster_addr":"10.20.193.127:6827/380098770","heartbeat_back_addr":"10.20.193.127:6831/380098770","heartbeat_front_addr":"10.20.193.127:6829/380098770","state":["exists","up"]},{"osd":11,"uuid":"0d51bb23-8f23-43b5-b697-ca294fd39e89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6825","nonce":3785556542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6827","nonce":3785556542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6831","nonce":3785556542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6829","nonce":3785556542}]},"public_addr":"10.20.193.177:6825/3785556542","cluster_addr":"10.20.193.177:6827/3785556542","heartbeat_back_addr":"10.20.193.177:6831/3785556542","heartbeat_front_addr":"10.20.193.177:6829/3785556542","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:43.223664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:50.561682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:57.716321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:05.230108+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:12.548595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:19.918131+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:27.198884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:34.668843+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:42.036449+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:49.563635+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:57.025291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.70:6801/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:6800/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/1475427018":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/2220510112":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/3723878791":"2026-02-14T03:43:02.018661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:45:07.033 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f919c0b5600 msgr2=0x7f919c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.033 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f919c0b5600 0x7f919c0d5ab0 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91b0004750 tx=0x7f91b00096a0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.033 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 msgr2=0x7f91c011d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.033 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 0x7f91c011d740 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91a800b800 tx=0x7f91a800bcd0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.033 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 shutdown_connections 2026-02-13T03:45:07.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f919c0b5600 0x7f919c0d5ab0 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91c0122b00 0x7f91c0122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91c0115440 0x7f91c011d740 unknown :-1 s=CLOSED pgs=191 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 --2- 10.20.193.70:0/4218620045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91c010f230 0x7f91c011d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 >> 10.20.193.70:0/4218620045 conn(0x7f91c00ecb30 msgr2=0x7f91c010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:07.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 shutdown_connections 2026-02-13T03:45:07.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.030+0000 7f91c723c6c0 1 -- 10.20.193.70:0/4218620045 wait complete. 2026-02-13T03:45:07.073 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T03:43:58.913146+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T03:45:07.074 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-13T03:45:07.191 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:07.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:07 trial070 ceph-mon[24757]: purged_snaps scrub starts 2026-02-13T03:45:07.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:07 trial070 ceph-mon[24757]: purged_snaps scrub ok 2026-02-13T03:45:07.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:07 trial070 ceph-mon[24757]: pgmap v167: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:07.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:07 trial070 ceph-mon[24757]: osd.11 [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] boot 2026-02-13T03:45:07.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:07 trial070 ceph-mon[24757]: osdmap e65: 12 total, 12 up, 12 in 2026-02-13T03:45:07.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:07 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:07.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:07 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3593781932' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:45:07.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:07 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4218620045' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:07.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 -- 10.20.193.70:0/3597009483 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718066ce0 msgr2=0x7fc7180670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 --2- 10.20.193.70:0/3597009483 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718066ce0 0x7fc7180670b0 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=4892711928517605218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc710009970 tx=0x7fc71002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:07.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 -- 10.20.193.70:0/3597009483 shutdown_connections 2026-02-13T03:45:07.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 --2- 10.20.193.70:0/3597009483 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc718159b20 0x7fc718179f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 --2- 10.20.193.70:0/3597009483 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7180675f0 0x7fc7181595e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 --2- 10.20.193.70:0/3597009483 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718066ce0 0x7fc7180670b0 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=4892711928517605218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 -- 10.20.193.70:0/3597009483 >> 10.20.193.70:0/3597009483 conn(0x7fc718064810 msgr2=0x7fc718064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:07.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 -- 10.20.193.70:0/3597009483 shutdown_connections 2026-02-13T03:45:07.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 -- 10.20.193.70:0/3597009483 wait complete. 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 Processor -- start 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 -- start start 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc718066ce0 0x7fc7181659c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7180675f0 0x7fc718165f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718159b20 0x7fc71816b2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc71816b910 con 0x7fc718159b20 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc71816ba80 con 0x7fc718066ce0 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc7208856c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc71816bc40 con 0x7fc7180675f0 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc71edf76c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718159b20 0x7fc71816b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc71edf76c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718159b20 0x7fc71816b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:51960/0 (socket says 10.20.193.70:51960) 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc71edf76c0 1 -- 10.20.193.70:0/2210074968 learned_addr learned my addr 10.20.193.70:0/2210074968 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:07.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc71e5f66c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc718066ce0 0x7fc7181659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc71edf76c0 1 -- 10.20.193.70:0/2210074968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7180675f0 msgr2=0x7fc718165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc71edf76c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7180675f0 0x7fc718165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc71edf76c0 1 -- 10.20.193.70:0/2210074968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc718066ce0 msgr2=0x7fc7181659c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.307+0000 7fc71edf76c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc718066ce0 0x7fc7181659c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.308+0000 7fc71edf76c0 1 -- 10.20.193.70:0/2210074968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc710009590 con 0x7fc718159b20 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.308+0000 7fc71edf76c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718159b20 0x7fc71816b2c0 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc70c00c710 tx=0x7fc70c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.308+0000 7fc7037fe6c0 1 -- 10.20.193.70:0/2210074968 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc70c003a30 con 0x7fc718159b20 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.308+0000 7fc7037fe6c0 1 -- 10.20.193.70:0/2210074968 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc70c0054f0 con 0x7fc718159b20 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.308+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71816bf20 con 0x7fc718159b20 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.308+0000 7fc7037fe6c0 1 -- 10.20.193.70:0/2210074968 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc70c00dc00 con 0x7fc718159b20 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.308+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc718155750 con 0x7fc718159b20 2026-02-13T03:45:07.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.308+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7180681f0 con 0x7fc718159b20 2026-02-13T03:45:07.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.310+0000 7fc7037fe6c0 1 -- 10.20.193.70:0/2210074968 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fc70c005030 con 0x7fc718159b20 2026-02-13T03:45:07.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.310+0000 7fc7037fe6c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc6f40b5680 0x7fc6f40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:07.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.310+0000 7fc71e5f66c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc6f40b5680 0x7fc6f40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:07.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.310+0000 7fc7037fe6c0 1 -- 10.20.193.70:0/2210074968 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7fc70c0e4600 con 0x7fc718159b20 2026-02-13T03:45:07.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.310+0000 7fc7037fe6c0 1 -- 10.20.193.70:0/2210074968 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc70c0aa6d0 con 0x7fc718159b20 2026-02-13T03:45:07.315 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.311+0000 7fc71e5f66c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc6f40b5680 0x7fc6f40d5b30 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc710005b40 tx=0x7fc710005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:07.404 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.402+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc718166b70 con 0x7fc718159b20 2026-02-13T03:45:07.404 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.402+0000 7fc7037fe6c0 1 -- 10.20.193.70:0/2210074968 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) ==== 93+0+10 (secure 0 0 0) 0x7fc70c0aa8b0 con 0x7fc718159b20 2026-02-13T03:45:07.405 INFO:teuthology.orchestra.run.trial070.stdout:pg_num: 1 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc6f40b5680 msgr2=0x7fc6f40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc6f40b5680 0x7fc6f40d5b30 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc710005b40 tx=0x7fc710005c00 comp rx=0 tx=0).stop 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718159b20 msgr2=0x7fc71816b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718159b20 0x7fc71816b2c0 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc70c00c710 tx=0x7fc70c00cbe0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 shutdown_connections 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc6f40b5680 0x7fc6f40d5b30 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc718159b20 0x7fc71816b2c0 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7180675f0 0x7fc718165f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 --2- 10.20.193.70:0/2210074968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc718066ce0 0x7fc7181659c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 >> 10.20.193.70:0/2210074968 conn(0x7fc718064810 msgr2=0x7fc7181601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:07.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 shutdown_connections 2026-02-13T03:45:07.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:07.403+0000 7fc7208856c0 1 -- 10.20.193.70:0/2210074968 wait complete. 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.a on trial070 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.d on trial070 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.g on trial070 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.j on trial070 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.b on trial127 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.e on trial127 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.h on trial127 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.k on trial127 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.c on trial177 2026-02-13T03:45:07.446 INFO:tasks.cephadm:Adding mds.f on trial177 2026-02-13T03:45:07.447 INFO:tasks.cephadm:Adding mds.i on trial177 2026-02-13T03:45:07.447 INFO:tasks.cephadm:Adding mds.l on trial177 2026-02-13T03:45:07.447 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph orch apply mds all '12;trial070=a;trial070=d;trial070=g;trial070=j;trial127=b;trial127=e;trial127=h;trial127=k;trial177=c;trial177=f;trial177=i;trial177=l' 2026-02-13T03:45:07.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:07 trial177 ceph-mon[27082]: purged_snaps scrub starts 2026-02-13T03:45:07.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:07 trial177 ceph-mon[27082]: purged_snaps scrub ok 2026-02-13T03:45:07.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:07 trial177 ceph-mon[27082]: pgmap v167: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:07.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:07 trial177 ceph-mon[27082]: osd.11 [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] boot 2026-02-13T03:45:07.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:07 trial177 ceph-mon[27082]: osdmap e65: 12 total, 12 up, 12 in 2026-02-13T03:45:07.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:07 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:07.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:07 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3593781932' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:45:07.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:07 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4218620045' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:07.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:07 trial127 ceph-mon[26439]: purged_snaps scrub starts 2026-02-13T03:45:07.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:07 trial127 ceph-mon[26439]: purged_snaps scrub ok 2026-02-13T03:45:07.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:07 trial127 ceph-mon[26439]: pgmap v167: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T03:45:07.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:07 trial127 ceph-mon[26439]: osd.11 [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] boot 2026-02-13T03:45:07.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:07 trial127 ceph-mon[26439]: osdmap e65: 12 total, 12 up, 12 in 2026-02-13T03:45:07.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:07 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T03:45:07.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:07 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3593781932' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T03:45:07.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:07 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4218620045' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:07.571 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:45:07.702 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.697+0000 7f45d6e556c0 1 -- 10.20.193.177:0/1931766798 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d010eed0 msgr2=0x7f45d010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.702 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.697+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/1931766798 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d010eed0 0x7f45d010f2c0 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=6188367029803723703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45c0009970 tx=0x7f45c002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:07.702 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 -- 10.20.193.177:0/1931766798 shutdown_connections 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/1931766798 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45d0110a00 0x7f45d0171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/1931766798 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f45d0110050 0x7f45d01104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/1931766798 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d010eed0 0x7f45d010f2c0 unknown :-1 s=CLOSED pgs=45 gs=1 cs=0 l=1 c_cookie=6188367029803723703 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 -- 10.20.193.177:0/1931766798 >> 10.20.193.177:0/1931766798 conn(0x7f45d00ec5f0 msgr2=0x7f45d010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 -- 10.20.193.177:0/1931766798 shutdown_connections 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 -- 10.20.193.177:0/1931766798 wait complete. 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 Processor -- start 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 -- start start 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45d010eed0 0x7f45d00f8680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f45d0110050 0x7f45d0171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:07.703 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d0110a00 0x7f45d00f8ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45d00f9b10 con 0x7f45d0110050 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f45d00f9c80 con 0x7f45d010eed0 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d6e556c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f45d00f9e40 con 0x7f45d0110a00 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d53c76c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d0110a00 0x7f45d00f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d53c76c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d0110a00 0x7f45d00f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:46498/0 (socket says 10.20.193.177:46498) 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d53c76c0 1 -- 10.20.193.177:0/590183774 learned_addr learned my addr 10.20.193.177:0/590183774 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d4bc66c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45d010eed0 0x7f45d00f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45c7fff6c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f45d0110050 0x7f45d0171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d53c76c0 1 -- 10.20.193.177:0/590183774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45d010eed0 msgr2=0x7f45d00f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d53c76c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45d010eed0 0x7f45d00f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d53c76c0 1 -- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f45d0110050 msgr2=0x7f45d0171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.704 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d53c76c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f45d0110050 0x7f45d0171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.705 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d53c76c0 1 -- 10.20.193.177:0/590183774 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c0009590 con 0x7f45d0110a00 2026-02-13T03:45:07.705 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.698+0000 7f45d53c76c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d0110a00 0x7f45d00f8ee0 secure :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45cc006ea0 tx=0x7f45cc00cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:07.705 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.699+0000 7f45c5ffb6c0 1 -- 10.20.193.177:0/590183774 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45cc003a30 con 0x7f45d0110a00 2026-02-13T03:45:07.705 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.699+0000 7f45c5ffb6c0 1 -- 10.20.193.177:0/590183774 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f45cc0054f0 con 0x7f45d0110a00 2026-02-13T03:45:07.705 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.699+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d00fa120 con 0x7f45d0110a00 2026-02-13T03:45:07.705 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.699+0000 7f45c5ffb6c0 1 -- 10.20.193.177:0/590183774 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45cc00dcd0 con 0x7f45d0110a00 2026-02-13T03:45:07.705 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.699+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d00fa600 con 0x7f45d0110a00 2026-02-13T03:45:07.705 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.699+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d01752c0 con 0x7f45d0110a00 2026-02-13T03:45:07.706 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.700+0000 7f45c5ffb6c0 1 -- 10.20.193.177:0/590183774 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f45cc005030 con 0x7f45d0110a00 2026-02-13T03:45:07.706 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.701+0000 7f45c5ffb6c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f45ac0b5680 0x7f45ac0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:07.706 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.701+0000 7f45c5ffb6c0 1 -- 10.20.193.177:0/590183774 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7f45cc0e46a0 con 0x7f45d0110a00 2026-02-13T03:45:07.706 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.701+0000 7f45d4bc66c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f45ac0b5680 0x7f45ac0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:07.707 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.701+0000 7f45c5ffb6c0 1 -- 10.20.193.177:0/590183774 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f45cc0a7580 con 0x7f45d0110a00 2026-02-13T03:45:07.707 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.701+0000 7f45d4bc66c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f45ac0b5680 0x7f45ac0d5b30 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45c002fa20 tx=0x7f45c0005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:07.799 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.796+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial070=a;trial070=d;trial070=g;trial070=j;trial127=b;trial127=e;trial127=h;trial127=k;trial177=c;trial177=f;trial177=i;trial177=l", "target": ["mon-mgr", ""]}) -- 0x7f45d00f1520 con 0x7f45ac0b5680 2026-02-13T03:45:07.805 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.802+0000 7f45c5ffb6c0 1 -- 10.20.193.177:0/590183774 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f45d00f1520 con 0x7f45ac0b5680 2026-02-13T03:45:07.805 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled mds.all update... 2026-02-13T03:45:07.806 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.803+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f45ac0b5680 msgr2=0x7f45ac0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.803+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f45ac0b5680 0x7f45ac0d5b30 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45c002fa20 tx=0x7f45c0005c00 comp rx=0 tx=0).stop 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d0110a00 msgr2=0x7f45d00f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d0110a00 0x7f45d00f8ee0 secure :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45cc006ea0 tx=0x7f45cc00cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 shutdown_connections 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f45ac0b5680 0x7f45ac0d5b30 unknown :-1 s=CLOSED pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45d0110a00 0x7f45d00f8ee0 unknown :-1 s=CLOSED pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f45d0110050 0x7f45d0171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 --2- 10.20.193.177:0/590183774 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f45d010eed0 0x7f45d00f8680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 >> 10.20.193.177:0/590183774 conn(0x7f45d00ec5f0 msgr2=0x7f45d00eec10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 shutdown_connections 2026-02-13T03:45:07.807 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-13T03:45:07.804+0000 7f45d6e556c0 1 -- 10.20.193.177:0/590183774 wait complete. 2026-02-13T03:45:07.847 DEBUG:teuthology.orchestra.run.trial070:mds.a> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.a.service 2026-02-13T03:45:07.849 DEBUG:teuthology.orchestra.run.trial070:mds.d> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.d.service 2026-02-13T03:45:07.892 DEBUG:teuthology.orchestra.run.trial070:mds.g> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.g.service 2026-02-13T03:45:07.935 DEBUG:teuthology.orchestra.run.trial070:mds.j> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.j.service 2026-02-13T03:45:07.978 DEBUG:teuthology.orchestra.run.trial127:mds.b> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.b.service 2026-02-13T03:45:07.981 DEBUG:teuthology.orchestra.run.trial127:mds.e> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.e.service 2026-02-13T03:45:08.025 DEBUG:teuthology.orchestra.run.trial127:mds.h> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.h.service 2026-02-13T03:45:08.067 DEBUG:teuthology.orchestra.run.trial127:mds.k> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.k.service 2026-02-13T03:45:08.110 DEBUG:teuthology.orchestra.run.trial177:mds.c> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.c.service 2026-02-13T03:45:08.113 DEBUG:teuthology.orchestra.run.trial177:mds.f> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.f.service 2026-02-13T03:45:08.156 DEBUG:teuthology.orchestra.run.trial177:mds.i> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.i.service 2026-02-13T03:45:08.199 DEBUG:teuthology.orchestra.run.trial177:mds.l> sudo journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.l.service 2026-02-13T03:45:08.243 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-13T03:45:08.244 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:45:08.360 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:08.374 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: osdmap e66: 12 total, 12 up, 12 in 2026-02-13T03:45:08.375 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2210074968' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T03:45:08.375 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:08.375 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:08.375 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:08.375 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:08.375 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:08.375 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:08.375 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:08.375 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:08 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:08.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: osdmap e66: 12 total, 12 up, 12 in 2026-02-13T03:45:08.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2210074968' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T03:45:08.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:08.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:08.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:08.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:08.377 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:08.377 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:08.377 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:08.377 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:08 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:08.409 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: osdmap e66: 12 total, 12 up, 12 in 2026-02-13T03:45:08.409 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2210074968' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T03:45:08.409 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:08.409 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:08.409 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:08.409 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:08.409 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:08.409 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:08.410 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:08.410 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:08 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:08.477 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.473+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/3124683380 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc10f230 msgr2=0x7f55bc10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.473+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/3124683380 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc10f230 0x7f55bc10f600 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=7292441165367947921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55b00099a0 tx=0x7f55b002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.473+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/3124683380 shutdown_connections 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.473+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/3124683380 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55bc115440 0x7f55bc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.473+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/3124683380 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55bc10fc20 0x7f55bc114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.473+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/3124683380 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc10f230 0x7f55bc10f600 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=7292441165367947921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.473+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/3124683380 >> 10.20.193.70:0/3124683380 conn(0x7f55bc0ecb30 msgr2=0x7f55bc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/3124683380 shutdown_connections 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/3124683380 wait complete. 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 Processor -- start 2026-02-13T03:45:08.478 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 -- start start 2026-02-13T03:45:08.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55bc10f230 0x7f55bc11d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:08.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55bc115440 0x7f55bc11d7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:08.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc122b80 0x7f55bc123020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:08.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc123590 con 0x7f55bc122b80 2026-02-13T03:45:08.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc123700 con 0x7f55bc115440 2026-02-13T03:45:08.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55c0cf06c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc1238c0 con 0x7f55bc10f230 2026-02-13T03:45:08.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55bad766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc122b80 0x7f55bc123020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:08.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55bad766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc122b80 0x7f55bc123020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:51974/0 (socket says 10.20.193.70:51974) 2026-02-13T03:45:08.479 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55bad766c0 1 -- 10.20.193.70:0/1485152554 learned_addr learned my addr 10.20.193.70:0/1485152554 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55b9d746c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55bc115440 0x7f55bc11d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55ba5756c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55bc10f230 0x7f55bc11d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55bad766c0 1 -- 10.20.193.70:0/1485152554 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55bc10f230 msgr2=0x7f55bc11d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55bad766c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55bc10f230 0x7f55bc11d280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55bad766c0 1 -- 10.20.193.70:0/1485152554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55bc115440 msgr2=0x7f55bc11d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55bad766c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55bc115440 0x7f55bc11d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.474+0000 7f55bad766c0 1 -- 10.20.193.70:0/1485152554 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b0009590 con 0x7f55bc122b80 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.475+0000 7f55bad766c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc122b80 0x7f55bc123020 secure :-1 s=READY pgs=195 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55ac00c6c0 tx=0x7f55ac00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.475+0000 7f55a37fe6c0 1 -- 10.20.193.70:0/1485152554 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55ac003a30 con 0x7f55bc122b80 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.475+0000 7f55a37fe6c0 1 -- 10.20.193.70:0/1485152554 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f55ac0054e0 con 0x7f55bc122b80 2026-02-13T03:45:08.480 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.475+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc163d70 con 0x7f55bc122b80 2026-02-13T03:45:08.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.475+0000 7f55a37fe6c0 1 -- 10.20.193.70:0/1485152554 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55ac00dc50 con 0x7f55bc122b80 2026-02-13T03:45:08.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.475+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc164200 con 0x7f55bc122b80 2026-02-13T03:45:08.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.475+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc110500 con 0x7f55bc122b80 2026-02-13T03:45:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.476+0000 7f55a37fe6c0 1 -- 10.20.193.70:0/1485152554 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f55ac005080 con 0x7f55bc122b80 2026-02-13T03:45:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.477+0000 7f55a37fe6c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f55940b5680 0x7f55940d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.477+0000 7f55ba5756c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f55940b5680 0x7f55940d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.477+0000 7f55a37fe6c0 1 -- 10.20.193.70:0/1485152554 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7f55ac0e4470 con 0x7f55bc122b80 2026-02-13T03:45:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.477+0000 7f55ba5756c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f55940b5680 0x7f55940d5b30 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55b00023e0 tx=0x7f55b0005c60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.477+0000 7f55a37fe6c0 1 -- 10.20.193.70:0/1485152554 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f55ac0a7390 con 0x7f55bc122b80 2026-02-13T03:45:08.599 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.597+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55bc10f600 con 0x7f55bc122b80 2026-02-13T03:45:08.599 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.597+0000 7f55a37fe6c0 1 -- 10.20.193.70:0/1485152554 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f55ac00de60 con 0x7f55bc122b80 2026-02-13T03:45:08.600 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:08.600 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":1,"btime":"2026-02-13T03:42:55:978956+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-13T03:45:08.600 INFO:teuthology.orchestra.run.trial070.stderr:dumped fsmap epoch 1 2026-02-13T03:45:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.599+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f55940b5680 msgr2=0x7f55940d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.599+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f55940b5680 0x7f55940d5b30 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55b00023e0 tx=0x7f55b0005c60 comp rx=0 tx=0).stop 2026-02-13T03:45:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.599+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc122b80 msgr2=0x7f55bc123020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.599+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc122b80 0x7f55bc123020 secure :-1 s=READY pgs=195 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55ac00c6c0 tx=0x7f55ac00cb90 comp rx=0 tx=0).stop 2026-02-13T03:45:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.600+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 shutdown_connections 2026-02-13T03:45:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.600+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f55940b5680 0x7f55940d5b30 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.600+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f55bc122b80 0x7f55bc123020 unknown :-1 s=CLOSED pgs=195 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.600+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f55bc115440 0x7f55bc11d7c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.600+0000 7f55c0cf06c0 1 --2- 10.20.193.70:0/1485152554 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55bc10f230 0x7f55bc11d280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.600+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 >> 10.20.193.70:0/1485152554 conn(0x7f55bc0ecb30 msgr2=0x7f55bc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.600+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 shutdown_connections 2026-02-13T03:45:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:08.600+0000 7f55c0cf06c0 1 -- 10.20.193.70:0/1485152554 wait complete. 2026-02-13T03:45:09.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:09 trial177 ceph-mon[27082]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:09.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:09 trial177 ceph-mon[27082]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial070=a;trial070=d;trial070=g;trial070=j;trial127=b;trial127=e;trial127=h;trial127=k;trial177=c;trial177=f;trial177=i;trial177=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:09.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:09 trial177 ceph-mon[27082]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:09.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:09 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:45:09.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:09 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:45:09.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:09 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:09.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:09 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:09.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:09 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:09.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:09 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1485152554' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:09.453 INFO:journalctl@ceph.mds.l.trial177.stdout:Feb 13 03:45:09 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-l[55126]: starting mds.l at 2026-02-13T03:45:09.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:09 trial127 ceph-mon[26439]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:09.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:09 trial127 ceph-mon[26439]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial070=a;trial070=d;trial070=g;trial070=j;trial127=b;trial127=e;trial127=h;trial127=k;trial177=c;trial177=f;trial177=i;trial177=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:09.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:09 trial127 ceph-mon[26439]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:09.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:09 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:45:09.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:09 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:45:09.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:09 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:09.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:09 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:09.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:09 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:09.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:09 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1485152554' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:09.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:09 trial070 ceph-mon[24757]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:09.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:09 trial070 ceph-mon[24757]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial070=a;trial070=d;trial070=g;trial070=j;trial127=b;trial127=e;trial127=h;trial127=k;trial177=c;trial177=f;trial177=i;trial177=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:09.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:09 trial070 ceph-mon[24757]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:09.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:09 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:45:09.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:09 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:45:09.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:09 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:09.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:09 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:09.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:09 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:09.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:09 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1485152554' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:09.932 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:45:09 trial127 systemd[1]: Starting Ceph mds.k for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:45:10.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:45:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.177:6832/787205513,v1:10.20.193.177:6833/787205513] up:boot 2026-02-13T03:45:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: fsmap 1 up:standby 2026-02-13T03:45:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T03:45:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:10.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:10.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:10.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:10.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:10.225 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:10.226 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:45:10 trial127 podman[54271]: 2026-02-13 03:45:10.015507631 +0000 UTC m=+0.016917331 container create 0d6fc94aeb5c36370c52f2b94b0bc3da83bf4b5cd841d12e803bf7e6b96859f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-k, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, ceph=True, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, version=10) 2026-02-13T03:45:10.226 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:45:10 trial127 podman[54271]: 2026-02-13 03:45:10.038978685 +0000 UTC m=+0.040388304 container init 0d6fc94aeb5c36370c52f2b94b0bc3da83bf4b5cd841d12e803bf7e6b96859f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-k, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, summary=Rocky Linux Base image, name=rockylinux, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7) 2026-02-13T03:45:10.226 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:45:10 trial127 podman[54271]: 2026-02-13 03:45:10.041011339 +0000 UTC m=+0.042420948 container start 0d6fc94aeb5c36370c52f2b94b0bc3da83bf4b5cd841d12e803bf7e6b96859f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-k, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , version=10, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-13T03:45:10.226 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:45:10 trial127 bash[54271]: 0d6fc94aeb5c36370c52f2b94b0bc3da83bf4b5cd841d12e803bf7e6b96859f3 2026-02-13T03:45:10.226 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:45:10 trial127 podman[54271]: 2026-02-13 03:45:10.007930132 +0000 UTC m=+0.009339751 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:45:10.226 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:45:10 trial127 systemd[1]: Started Ceph mds.k for 0c5cf8b4-088e-11f1-b830-d404e6e7d460. 2026-02-13T03:45:10.226 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:45:10 trial127 ceph-mds[54297]: -- 10.20.193.127:0/2839451275 <== mon.2 v2:10.20.193.127:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56250df4b860 con 0x56250e001800 2026-02-13T03:45:10.227 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:45:10 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-k[54293]: starting mds.k at 2026-02-13T03:45:10.424 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:10.424 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:45:10.424 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.177:6832/787205513,v1:10.20.193.177:6833/787205513] up:boot 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: fsmap 1 up:standby 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.425 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.426 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.426 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:10.426 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:10.426 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:10 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:10.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:10.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.177:6832/787205513,v1:10.20.193.177:6833/787205513] up:boot 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: fsmap 1 up:standby 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:10.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:10.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:10.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:10 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:10.642 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:45:10.840 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:10.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.949+0000 7fc047b546c0 1 -- 10.20.193.70:0/242717394 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc04010f230 msgr2=0x7fc04010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:10.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.949+0000 7fc047b546c0 1 --2- 10.20.193.70:0/242717394 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc04010f230 0x7fc04010f600 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=4533783027847098505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0300099a0 tx=0x7fc03002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:10.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.949+0000 7fc047b546c0 1 -- 10.20.193.70:0/242717394 shutdown_connections 2026-02-13T03:45:10.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.949+0000 7fc047b546c0 1 --2- 10.20.193.70:0/242717394 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc040115440 0x7fc040175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:10.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.949+0000 7fc047b546c0 1 --2- 10.20.193.70:0/242717394 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc04010fc20 0x7fc040114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:10.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.949+0000 7fc047b546c0 1 --2- 10.20.193.70:0/242717394 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc04010f230 0x7fc04010f600 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=4533783027847098505 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:10.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.949+0000 7fc047b546c0 1 -- 10.20.193.70:0/242717394 >> 10.20.193.70:0/242717394 conn(0x7fc0400ecb30 msgr2=0x7fc04010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.949+0000 7fc047b546c0 1 -- 10.20.193.70:0/242717394 shutdown_connections 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.949+0000 7fc047b546c0 1 -- 10.20.193.70:0/242717394 wait complete. 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 Processor -- start 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 -- start start 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc04010f230 0x7fc04011d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc040115440 0x7fc04011d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc040122c20 0x7fc0401230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc040123630 con 0x7fc040122c20 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc0401237a0 con 0x7fc040115440 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc040123960 con 0x7fc04010f230 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0460ca6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc040122c20 0x7fc0401230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0460ca6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc040122c20 0x7fc0401230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52004/0 (socket says 10.20.193.70:52004) 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0460ca6c0 1 -- 10.20.193.70:0/2543690476 learned_addr learned my addr 10.20.193.70:0/2543690476 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0458c96c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc04010f230 0x7fc04011d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0450c86c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc040115440 0x7fc04011d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0460ca6c0 1 -- 10.20.193.70:0/2543690476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc04010f230 msgr2=0x7fc04011d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0460ca6c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc04010f230 0x7fc04011d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0460ca6c0 1 -- 10.20.193.70:0/2543690476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc040115440 msgr2=0x7fc04011d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0460ca6c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc040115440 0x7fc04011d860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0460ca6c0 1 -- 10.20.193.70:0/2543690476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc030009590 con 0x7fc040122c20 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0458c96c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc04010f230 0x7fc04011d320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc0460ca6c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc040122c20 0x7fc0401230c0 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc03c006ea0 tx=0x7fc03c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc02effd6c0 1 -- 10.20.193.70:0/2543690476 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc03c003a30 con 0x7fc040122c20 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc02effd6c0 1 -- 10.20.193.70:0/2543690476 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc03c0054f0 con 0x7fc040122c20 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc040163e10 con 0x7fc040122c20 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc02effd6c0 1 -- 10.20.193.70:0/2543690476 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc03c00dcd0 con 0x7fc040122c20 2026-02-13T03:45:10.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.950+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0401642f0 con 0x7fc040122c20 2026-02-13T03:45:10.954 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.951+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc040110500 con 0x7fc040122c20 2026-02-13T03:45:10.954 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.952+0000 7fc02effd6c0 1 -- 10.20.193.70:0/2543690476 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fc03c005030 con 0x7fc040122c20 2026-02-13T03:45:10.954 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.952+0000 7fc02effd6c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc01c0b5680 0x7fc01c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:10.954 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.953+0000 7fc0458c96c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc01c0b5680 0x7fc01c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:10.954 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.953+0000 7fc02effd6c0 1 -- 10.20.193.70:0/2543690476 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7fc03c0e46f0 con 0x7fc040122c20 2026-02-13T03:45:10.954 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.953+0000 7fc0458c96c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc01c0b5680 0x7fc01c0d5b30 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc030005b40 tx=0x7fc030005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:10.955 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:10.953+0000 7fc02effd6c0 1 -- 10.20.193.70:0/2543690476 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc03c0a75d0 con 0x7fc040122c20 2026-02-13T03:45:11.076 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.073+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc04010f600 con 0x7fc040122c20 2026-02-13T03:45:11.076 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.073+0000 7fc02effd6c0 1 -- 10.20.193.70:0/2543690476 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7fc03c00de60 con 0x7fc040122c20 2026-02-13T03:45:11.076 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:11.077 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":3,"btime":"2026-02-13T03:45:10:258056+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/2607551184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":2607551184},{"type":"v1","addr":"10.20.193.127:6833","nonce":2607551184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/787205513","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":787205513},{"type":"v1","addr":"10.20.193.177:6833","nonce":787205513}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2026-02-13T03:45:11.078 INFO:teuthology.orchestra.run.trial070.stderr:dumped fsmap epoch 3 2026-02-13T03:45:11.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc01c0b5680 msgr2=0x7fc01c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:11.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc01c0b5680 0x7fc01c0d5b30 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc030005b40 tx=0x7fc030005c00 comp rx=0 tx=0).stop 2026-02-13T03:45:11.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc040122c20 msgr2=0x7fc0401230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:11.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc040122c20 0x7fc0401230c0 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc03c006ea0 tx=0x7fc03c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:11.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 shutdown_connections 2026-02-13T03:45:11.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc01c0b5680 0x7fc01c0d5b30 unknown :-1 s=CLOSED pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:11.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc040122c20 0x7fc0401230c0 unknown :-1 s=CLOSED pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:11.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc040115440 0x7fc04011d860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:11.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 --2- 10.20.193.70:0/2543690476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc04010f230 0x7fc04011d320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:11.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 >> 10.20.193.70:0/2543690476 conn(0x7fc0400ecb30 msgr2=0x7fc04010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:11.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 shutdown_connections 2026-02-13T03:45:11.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:11.075+0000 7fc047b546c0 1 -- 10.20.193.70:0/2543690476 wait complete. 2026-02-13T03:45:11.329 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.127:6832/2607551184,v1:10.20.193.127:6833/2607551184] up:boot 2026-02-13T03:45:11.329 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: fsmap 2 up:standby 2026-02-13T03:45:11.329 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T03:45:11.330 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:11.330 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:11.330 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:11.330 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:11.330 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:11.330 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:11.330 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:11.330 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:11 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2543690476' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:11.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.127:6832/2607551184,v1:10.20.193.127:6833/2607551184] up:boot 2026-02-13T03:45:11.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: fsmap 2 up:standby 2026-02-13T03:45:11.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T03:45:11.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:11.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:11.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:11.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:11.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:11.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:11.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:11.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:11 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2543690476' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:11.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.127:6832/2607551184,v1:10.20.193.127:6833/2607551184] up:boot 2026-02-13T03:45:11.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: fsmap 2 up:standby 2026-02-13T03:45:11.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T03:45:11.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:11.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:11.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:11.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:11.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:11.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:11.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:11.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:11 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2543690476' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:12.047 INFO:journalctl@ceph.mds.d.trial070.stdout:Feb 13 03:45:11 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-d[60940]: starting mds.d at 2026-02-13T03:45:12.443 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:45:12 trial127 systemd[1]: Starting Ceph mds.e for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:45:12.443 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.70:6834/4222419180,v1:10.20.193.70:6835/4222419180] up:boot 2026-02-13T03:45:12.444 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mon[26439]: fsmap 3 up:standby 2026-02-13T03:45:12.444 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T03:45:12.444 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:12.444 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:12.444 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:12.444 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:12.444 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:12.444 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:12.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:12 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.70:6834/4222419180,v1:10.20.193.70:6835/4222419180] up:boot 2026-02-13T03:45:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:12 trial070 ceph-mon[24757]: fsmap 3 up:standby 2026-02-13T03:45:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T03:45:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:12.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:12 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:12.602 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:12 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.70:6834/4222419180,v1:10.20.193.70:6835/4222419180] up:boot 2026-02-13T03:45:12.602 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:12 trial177 ceph-mon[27082]: fsmap 3 up:standby 2026-02-13T03:45:12.603 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T03:45:12.603 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:12.603 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:12.603 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:12.603 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:12.603 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:12.603 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:12 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:12.724 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:45:12 trial127 podman[54587]: 2026-02-13 03:45:12.526576412 +0000 UTC m=+0.016412481 container create 27c31b7de43188a3517c8e4516b50f947188bab476321cdf0125e20476dc8fad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-e, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.title=rockylinux, version=10, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:45:12.724 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:45:12 trial127 podman[54587]: 2026-02-13 03:45:12.552523745 +0000 UTC m=+0.042359814 container init 27c31b7de43188a3517c8e4516b50f947188bab476321cdf0125e20476dc8fad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-e, name=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T03:45:12.724 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:45:12 trial127 podman[54587]: 2026-02-13 03:45:12.554726858 +0000 UTC m=+0.044562917 container start 27c31b7de43188a3517c8e4516b50f947188bab476321cdf0125e20476dc8fad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-e, name=rockylinux, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T03:45:12.724 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:45:12 trial127 bash[54587]: 27c31b7de43188a3517c8e4516b50f947188bab476321cdf0125e20476dc8fad 2026-02-13T03:45:12.724 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:45:12 trial127 podman[54587]: 2026-02-13 03:45:12.518903204 +0000 UTC m=+0.008739283 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:45:12.724 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:45:12 trial127 systemd[1]: Started Ceph mds.e for 0c5cf8b4-088e-11f1-b830-d404e6e7d460. 2026-02-13T03:45:12.724 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:45:12 trial127 ceph-mds[54615]: -- 10.20.193.127:0/1828030537 <== mon.2 v2:10.20.193.127:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ddf2c7860 con 0x563ddf37d000 2026-02-13T03:45:12.725 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:45:12 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-e[54607]: starting mds.e at 2026-02-13T03:45:13.122 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:45:13.246 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:13.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 -- 10.20.193.70:0/969257103 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd33010f230 msgr2=0x7fd33010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:13.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 --2- 10.20.193.70:0/969257103 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd33010f230 0x7fd33010f600 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=13721144117086036200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3200099a0 tx=0x7fd32002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:13.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 -- 10.20.193.70:0/969257103 shutdown_connections 2026-02-13T03:45:13.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 --2- 10.20.193.70:0/969257103 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd330115440 0x7fd330175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 --2- 10.20.193.70:0/969257103 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd33010fc20 0x7fd330114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 --2- 10.20.193.70:0/969257103 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd33010f230 0x7fd33010f600 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=13721144117086036200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 -- 10.20.193.70:0/969257103 >> 10.20.193.70:0/969257103 conn(0x7fd3300ecb30 msgr2=0x7fd33010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 -- 10.20.193.70:0/969257103 shutdown_connections 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 -- 10.20.193.70:0/969257103 wait complete. 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 Processor -- start 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.368+0000 7fd3372146c0 1 -- start start 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3372146c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd33010f230 0x7fd33011d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3372146c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd330115440 0x7fd33011d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3372146c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd330122c20 0x7fd3301230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:13.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3372146c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd330123630 con 0x7fd330115440 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3372146c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301237a0 con 0x7fd330122c20 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3372146c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd330123960 con 0x7fd33010f230 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd327fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd330115440 0x7fd33011d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd327fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd330115440 0x7fd33011d860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52050/0 (socket says 10.20.193.70:52050) 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd327fff6c0 1 -- 10.20.193.70:0/389678672 learned_addr learned my addr 10.20.193.70:0/389678672 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3357866c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd330122c20 0x7fd3301230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd327fff6c0 1 -- 10.20.193.70:0/389678672 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd33010f230 msgr2=0x7fd33011d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd327fff6c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd33010f230 0x7fd33011d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd327fff6c0 1 -- 10.20.193.70:0/389678672 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd330122c20 msgr2=0x7fd3301230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd327fff6c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd330122c20 0x7fd3301230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd327fff6c0 1 -- 10.20.193.70:0/389678672 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd320009590 con 0x7fd330115440 2026-02-13T03:45:13.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd327fff6c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd330115440 0x7fd33011d860 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd31800b6c0 tx=0x7fd31800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:13.375 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd325ffb6c0 1 -- 10.20.193.70:0/389678672 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd318004250 con 0x7fd330115440 2026-02-13T03:45:13.375 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd325ffb6c0 1 -- 10.20.193.70:0/389678672 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd318009070 con 0x7fd330115440 2026-02-13T03:45:13.375 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd330163e10 con 0x7fd330115440 2026-02-13T03:45:13.375 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd325ffb6c0 1 -- 10.20.193.70:0/389678672 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd31800ccb0 con 0x7fd330115440 2026-02-13T03:45:13.375 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3301642a0 con 0x7fd330115440 2026-02-13T03:45:13.375 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.369+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd330110500 con 0x7fd330115440 2026-02-13T03:45:13.376 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.371+0000 7fd325ffb6c0 1 -- 10.20.193.70:0/389678672 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fd3180028c0 con 0x7fd330115440 2026-02-13T03:45:13.376 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.371+0000 7fd325ffb6c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd30c0b5600 0x7fd30c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:13.376 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.371+0000 7fd334f856c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd30c0b5600 0x7fd30c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:13.376 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.371+0000 7fd325ffb6c0 1 -- 10.20.193.70:0/389678672 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7fd3180e36b0 con 0x7fd330115440 2026-02-13T03:45:13.376 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.372+0000 7fd334f856c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd30c0b5600 0x7fd30c0d5ab0 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd320005b40 tx=0x7fd320005c60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:13.377 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.372+0000 7fd325ffb6c0 1 -- 10.20.193.70:0/389678672 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd3180a65d0 con 0x7fd330115440 2026-02-13T03:45:13.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.492+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd33011e4d0 con 0x7fd330115440 2026-02-13T03:45:13.495 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.70:6836/4178814163,v1:10.20.193.70:6837/4178814163] up:boot 2026-02-13T03:45:13.495 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: fsmap 4 up:standby 2026-02-13T03:45:13.495 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T03:45:13.496 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:13.496 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:13.496 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:13.496 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:13.496 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:13.496 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:13.496 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:13 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:13.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.493+0000 7fd325ffb6c0 1 -- 10.20.193.70:0/389678672 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7fd3180a9780 con 0x7fd330115440 2026-02-13T03:45:13.497 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:13.497 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":6,"btime":"2026-02-13T03:45:13:266406+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6835/4222419180","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6834","nonce":4222419180},{"type":"v1","addr":"10.20.193.70:6835","nonce":4222419180}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6837/4178814163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6836","nonce":4178814163},{"type":"v1","addr":"10.20.193.70:6837","nonce":4178814163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/2607551184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":2607551184},{"type":"v1","addr":"10.20.193.127:6833","nonce":2607551184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/787205513","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":787205513},{"type":"v1","addr":"10.20.193.177:6833","nonce":787205513}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6835/721965507","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":721965507},{"type":"v1","addr":"10.20.193.127:6835","nonce":721965507}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2026-02-13T03:45:13.498 INFO:teuthology.orchestra.run.trial070.stderr:dumped fsmap epoch 6 2026-02-13T03:45:13.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd30c0b5600 msgr2=0x7fd30c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:13.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd30c0b5600 0x7fd30c0d5ab0 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd320005b40 tx=0x7fd320005c60 comp rx=0 tx=0).stop 2026-02-13T03:45:13.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd330115440 msgr2=0x7fd33011d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:13.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd330115440 0x7fd33011d860 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd31800b6c0 tx=0x7fd31800bb90 comp rx=0 tx=0).stop 2026-02-13T03:45:13.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 shutdown_connections 2026-02-13T03:45:13.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd30c0b5600 0x7fd30c0d5ab0 unknown :-1 s=CLOSED pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:13.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd330122c20 0x7fd3301230c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:13.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd330115440 0x7fd33011d860 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:13.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 --2- 10.20.193.70:0/389678672 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd33010f230 0x7fd33011d320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:13.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 >> 10.20.193.70:0/389678672 conn(0x7fd3300ecb30 msgr2=0x7fd33010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:13.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 shutdown_connections 2026-02-13T03:45:13.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:13.494+0000 7fd3372146c0 1 -- 10.20.193.70:0/389678672 wait complete. 2026-02-13T03:45:13.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.70:6836/4178814163,v1:10.20.193.70:6837/4178814163] up:boot 2026-02-13T03:45:13.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: fsmap 4 up:standby 2026-02-13T03:45:13.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T03:45:13.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:13.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:13.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:13.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:13.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:13.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:13.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:13 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:13.703 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 13 03:45:13 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-f[55450]: starting mds.f at 2026-02-13T03:45:13.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.70:6836/4178814163,v1:10.20.193.70:6837/4178814163] up:boot 2026-02-13T03:45:13.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: fsmap 4 up:standby 2026-02-13T03:45:13.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T03:45:13.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:13.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:13.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:13.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:13.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:13.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:13.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:13 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:14.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.127:6834/721965507,v1:10.20.193.127:6835/721965507] up:boot 2026-02-13T03:45:14.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: fsmap 5 up:standby 2026-02-13T03:45:14.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T03:45:14.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:14.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:14.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:14.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:14.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:14.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:14.453 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/389678672' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:14.453 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 13 03:45:14 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-c[55779]: starting mds.c at 2026-02-13T03:45:14.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.127:6834/721965507,v1:10.20.193.127:6835/721965507] up:boot 2026-02-13T03:45:14.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: fsmap 5 up:standby 2026-02-13T03:45:14.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T03:45:14.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:14.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:14.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:14.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:14.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:14.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:14.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:14 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/389678672' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:14.660 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.127:6834/721965507,v1:10.20.193.127:6835/721965507] up:boot 2026-02-13T03:45:14.660 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: fsmap 5 up:standby 2026-02-13T03:45:14.660 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T03:45:14.660 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:14.660 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:14.661 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:14.661 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:14.661 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:14.661 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:14.661 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:14 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/389678672' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:15.277 INFO:journalctl@ceph.mds.h.trial127.stdout:Feb 13 03:45:15 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-h[54930]: starting mds.h at 2026-02-13T03:45:15.527 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.177:6834/1936668239,v1:10.20.193.177:6835/1936668239] up:boot 2026-02-13T03:45:15.527 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: fsmap 6 up:standby 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.528 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.529 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:15.529 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:15.529 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:15 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:15.537 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:45:15.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.177:6834/1936668239,v1:10.20.193.177:6835/1936668239] up:boot 2026-02-13T03:45:15.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: fsmap 6 up:standby 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:15.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:15.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:15 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:15.657 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:15.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.177:6834/1936668239,v1:10.20.193.177:6835/1936668239] up:boot 2026-02-13T03:45:15.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: fsmap 6 up:standby 2026-02-13T03:45:15.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:15.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:15.725 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:15 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:15.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 -- 10.20.193.70:0/3414376131 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa58115440 msgr2=0x7ffa58175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:15.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 --2- 10.20.193.70:0/3414376131 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa58115440 0x7ffa58175de0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=9582895339880835545 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa5400aa70 tx=0x7ffa5402fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 -- 10.20.193.70:0/3414376131 shutdown_connections 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 --2- 10.20.193.70:0/3414376131 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa58115440 0x7ffa58175de0 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=9582895339880835545 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 --2- 10.20.193.70:0/3414376131 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa5810fc20 0x7ffa58114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 --2- 10.20.193.70:0/3414376131 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa5810f230 0x7ffa5810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 -- 10.20.193.70:0/3414376131 >> 10.20.193.70:0/3414376131 conn(0x7ffa580ecb30 msgr2=0x7ffa5810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 -- 10.20.193.70:0/3414376131 shutdown_connections 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 -- 10.20.193.70:0/3414376131 wait complete. 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 Processor -- start 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 -- start start 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa5810f230 0x7ffa580f4c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa58115440 0x7ffa58175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa580f5250 0x7ffa580fa520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:15.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580f5940 con 0x7ffa5810f230 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580faa60 con 0x7ffa58115440 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa605356c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580fac20 con 0x7ffa580f5250 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.766+0000 7ffa5e2a66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa5810f230 0x7ffa580f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5e2a66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa5810f230 0x7ffa580f4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52070/0 (socket says 10.20.193.70:52070) 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5e2a66c0 1 -- 10.20.193.70:0/589795650 learned_addr learned my addr 10.20.193.70:0/589795650 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5daa56c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa58115440 0x7ffa58175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5eaa76c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa580f5250 0x7ffa580fa520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5e2a66c0 1 -- 10.20.193.70:0/589795650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa580f5250 msgr2=0x7ffa580fa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5e2a66c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa580f5250 0x7ffa580fa520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5e2a66c0 1 -- 10.20.193.70:0/589795650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa58115440 msgr2=0x7ffa58175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:15.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5e2a66c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa58115440 0x7ffa58175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.773 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5e2a66c0 1 -- 10.20.193.70:0/589795650 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5400a660 con 0x7ffa5810f230 2026-02-13T03:45:15.773 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5eaa76c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa580f5250 0x7ffa580fa520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:15.773 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa5e2a66c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa5810f230 0x7ffa580f4c20 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa4800b710 tx=0x7ffa4800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:15.773 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa3f7fe6c0 1 -- 10.20.193.70:0/589795650 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa48004250 con 0x7ffa5810f230 2026-02-13T03:45:15.773 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa3f7fe6c0 1 -- 10.20.193.70:0/589795650 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ffa48002d80 con 0x7ffa5810f230 2026-02-13T03:45:15.773 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa580faf00 con 0x7ffa5810f230 2026-02-13T03:45:15.773 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa3f7fe6c0 1 -- 10.20.193.70:0/589795650 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa4800ce50 con 0x7ffa5810f230 2026-02-13T03:45:15.773 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa580fb690 con 0x7ffa5810f230 2026-02-13T03:45:15.773 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.767+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa58110500 con 0x7ffa5810f230 2026-02-13T03:45:15.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.769+0000 7ffa3f7fe6c0 1 -- 10.20.193.70:0/589795650 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7ffa480043b0 con 0x7ffa5810f230 2026-02-13T03:45:15.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.769+0000 7ffa3f7fe6c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ffa340b5670 0x7ffa340d5b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:15.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.769+0000 7ffa5daa56c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ffa340b5670 0x7ffa340d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:15.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.769+0000 7ffa3f7fe6c0 1 -- 10.20.193.70:0/589795650 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7ffa480e35e0 con 0x7ffa5810f230 2026-02-13T03:45:15.774 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.770+0000 7ffa5daa56c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ffa340b5670 0x7ffa340d5b20 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa4c006b60 tx=0x7ffa4c006af0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:15.775 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.770+0000 7ffa3f7fe6c0 1 -- 10.20.193.70:0/589795650 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffa480a6500 con 0x7ffa5810f230 2026-02-13T03:45:15.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.887+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa580f5d70 con 0x7ffa5810f230 2026-02-13T03:45:15.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.887+0000 7ffa3f7fe6c0 1 -- 10.20.193.70:0/589795650 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+7222 (secure 0 0 0) 0x7ffa480a96b0 con 0x7ffa5810f230 2026-02-13T03:45:15.890 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:15.890 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":8,"btime":"2026-02-13T03:45:15:275562+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6835/4222419180","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6834","nonce":4222419180},{"type":"v1","addr":"10.20.193.70:6835","nonce":4222419180}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6837/4178814163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6836","nonce":4178814163},{"type":"v1","addr":"10.20.193.70:6837","nonce":4178814163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/2607551184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":2607551184},{"type":"v1","addr":"10.20.193.127:6833","nonce":2607551184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/787205513","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":787205513},{"type":"v1","addr":"10.20.193.177:6833","nonce":787205513}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6835/721965507","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":721965507},{"type":"v1","addr":"10.20.193.127:6835","nonce":721965507}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6835/1936668239","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":1936668239},{"type":"v1","addr":"10.20.193.177:6835","nonce":1936668239}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6837/2542438956","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":2542438956},{"type":"v1","addr":"10.20.193.177:6837","nonce":2542438956}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6837/4252675734","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":4252675734},{"type":"v1","addr":"10.20.193.127:6837","nonce":4252675734}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-13T03:45:15.891 INFO:teuthology.orchestra.run.trial070.stderr:dumped fsmap epoch 8 2026-02-13T03:45:15.891 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ffa340b5670 msgr2=0x7ffa340d5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:15.891 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ffa340b5670 0x7ffa340d5b20 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa4c006b60 tx=0x7ffa4c006af0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.891 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa5810f230 msgr2=0x7ffa580f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:15.891 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa5810f230 0x7ffa580f4c20 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa4800b710 tx=0x7ffa4800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.891 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 shutdown_connections 2026-02-13T03:45:15.891 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ffa340b5670 0x7ffa340d5b20 unknown :-1 s=CLOSED pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.891 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa580f5250 0x7ffa580fa520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.892 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ffa58115440 0x7ffa58175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.892 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 --2- 10.20.193.70:0/589795650 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ffa5810f230 0x7ffa580f4c20 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:15.892 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 >> 10.20.193.70:0/589795650 conn(0x7ffa580ecb30 msgr2=0x7ffa5810d830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:15.892 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 shutdown_connections 2026-02-13T03:45:15.892 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:15.889+0000 7ffa605356c0 1 -- 10.20.193.70:0/589795650 wait complete. 2026-02-13T03:45:16.201 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 13 03:45:15 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-i[56101]: starting mds.i at 2026-02-13T03:45:16.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.177:6836/2542438956,v1:10.20.193.177:6837/2542438956] up:boot 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.127:6836/4252675734,v1:10.20.193.127:6837/4252675734] up:boot 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: fsmap 8 up:standby 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/589795650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:16.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:16 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:16.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.177:6836/2542438956,v1:10.20.193.177:6837/2542438956] up:boot 2026-02-13T03:45:16.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.127:6836/4252675734,v1:10.20.193.127:6837/4252675734] up:boot 2026-02-13T03:45:16.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: fsmap 8 up:standby 2026-02-13T03:45:16.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T03:45:16.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T03:45:16.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/589795650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:16.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:16.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:16.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:16.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:16.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:16.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:16 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:16.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.177:6836/2542438956,v1:10.20.193.177:6837/2542438956] up:boot 2026-02-13T03:45:16.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.127:6836/4252675734,v1:10.20.193.127:6837/4252675734] up:boot 2026-02-13T03:45:16.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: fsmap 8 up:standby 2026-02-13T03:45:16.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T03:45:16.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T03:45:16.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/589795650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:16.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:16.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:16.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:16.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:16.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:16.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:16 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:17.047 INFO:journalctl@ceph.mds.g.trial070.stdout:Feb 13 03:45:16 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-g[61469]: starting mds.g at 2026-02-13T03:45:17.418 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.177:6838/145347701,v1:10.20.193.177:6839/145347701] up:boot 2026-02-13T03:45:17.419 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: fsmap 9 up:standby 2026-02-13T03:45:17.419 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T03:45:17.419 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:17.419 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:17.419 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:17.419 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:17.419 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:17.419 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:17.419 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:17.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.177:6838/145347701,v1:10.20.193.177:6839/145347701] up:boot 2026-02-13T03:45:17.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: fsmap 9 up:standby 2026-02-13T03:45:17.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T03:45:17.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:17.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:17.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:17.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:17.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:17.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:17.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:17 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:17.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.177:6838/145347701,v1:10.20.193.177:6839/145347701] up:boot 2026-02-13T03:45:17.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: fsmap 9 up:standby 2026-02-13T03:45:17.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T03:45:17.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:17.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:17.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:17.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:17.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:17.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:17.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:17 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:17.798 INFO:journalctl@ceph.mds.a.trial070.stdout:Feb 13 03:45:17 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-a[61791]: starting mds.a at 2026-02-13T03:45:17.933 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:45:18.053 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:18.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 -- 10.20.193.70:0/3485543485 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c9410fbf0 msgr2=0x7f5c94114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:18.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3485543485 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c9410fbf0 0x7f5c94114c30 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=10889448636596506548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c7c0099a0 tx=0x7f5c7c02ed50 comp rx=0 tx=0).stop 2026-02-13T03:45:18.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 -- 10.20.193.70:0/3485543485 shutdown_connections 2026-02-13T03:45:18.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3485543485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5c94115410 0x7f5c94175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:18.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3485543485 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c9410fbf0 0x7f5c94114c30 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=10889448636596506548 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:18.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3485543485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c9410f200 0x7f5c9410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:18.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 -- 10.20.193.70:0/3485543485 >> 10.20.193.70:0/3485543485 conn(0x7f5c940ecb00 msgr2=0x7f5c9410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:18.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 -- 10.20.193.70:0/3485543485 shutdown_connections 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 -- 10.20.193.70:0/3485543485 wait complete. 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 Processor -- start 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 -- start start 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c9410f200 0x7f5c940f4cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c94115410 0x7f5c94175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5c940f5320 0x7f5c940fa5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5c940f5980 con 0x7f5c94115410 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5c940faae0 con 0x7f5c940f5320 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c990216c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c940faca0 con 0x7f5c9410f200 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c925756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c94115410 0x7f5c94175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:18.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c925756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c94115410 0x7f5c94175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:51970/0 (socket says 10.20.193.70:51970) 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.172+0000 7f5c925756c0 1 -- 10.20.193.70:0/3643346499 learned_addr learned my addr 10.20.193.70:0/3643346499 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c935776c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5c940f5320 0x7f5c940fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c92d766c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c9410f200 0x7f5c940f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c925756c0 1 -- 10.20.193.70:0/3643346499 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c9410f200 msgr2=0x7f5c940f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c925756c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c9410f200 0x7f5c940f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c925756c0 1 -- 10.20.193.70:0/3643346499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5c940f5320 msgr2=0x7f5c940fa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c925756c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5c940f5320 0x7f5c940fa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c925756c0 1 -- 10.20.193.70:0/3643346499 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c009590 con 0x7f5c94115410 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c925756c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c94115410 0x7f5c94175cb0 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c7c0023a0 tx=0x7f5c7c02fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c73fff6c0 1 -- 10.20.193.70:0/3643346499 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c7c002ae0 con 0x7f5c94115410 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c73fff6c0 1 -- 10.20.193.70:0/3643346499 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5c7c002c40 con 0x7f5c94115410 2026-02-13T03:45:18.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c940faec0 con 0x7f5c94115410 2026-02-13T03:45:18.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c73fff6c0 1 -- 10.20.193.70:0/3643346499 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c7c037070 con 0x7f5c94115410 2026-02-13T03:45:18.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c940fb390 con 0x7f5c94115410 2026-02-13T03:45:18.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.173+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c941104d0 con 0x7f5c94115410 2026-02-13T03:45:18.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.175+0000 7f5c73fff6c0 1 -- 10.20.193.70:0/3643346499 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f5c7c0071c0 con 0x7f5c94115410 2026-02-13T03:45:18.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.175+0000 7f5c73fff6c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5c680b5680 0x7f5c680d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:18.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.176+0000 7f5c92d766c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5c680b5680 0x7f5c680d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:18.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.176+0000 7f5c73fff6c0 1 -- 10.20.193.70:0/3643346499 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7f5c7c107830 con 0x7f5c94115410 2026-02-13T03:45:18.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.176+0000 7f5c92d766c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5c680b5680 0x7f5c680d5b30 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c88004750 tx=0x7f5c88009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:18.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.176+0000 7f5c73fff6c0 1 -- 10.20.193.70:0/3643346499 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5c7c0ca750 con 0x7f5c94115410 2026-02-13T03:45:18.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.294+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c9410f5d0 con 0x7f5c94115410 2026-02-13T03:45:18.297 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.295+0000 7f5c73fff6c0 1 -- 10.20.193.70:0/3643346499 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8874 (secure 0 0 0) 0x7f5c7c0cd900 con 0x7f5c94115410 2026-02-13T03:45:18.297 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:18.297 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":10,"btime":"2026-02-13T03:45:17:321318+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6835/4222419180","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6834","nonce":4222419180},{"type":"v1","addr":"10.20.193.70:6835","nonce":4222419180}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6837/4178814163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6836","nonce":4178814163},{"type":"v1","addr":"10.20.193.70:6837","nonce":4178814163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6839/1271943071","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6838","nonce":1271943071},{"type":"v1","addr":"10.20.193.70:6839","nonce":1271943071}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/2607551184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":2607551184},{"type":"v1","addr":"10.20.193.127:6833","nonce":2607551184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/787205513","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":787205513},{"type":"v1","addr":"10.20.193.177:6833","nonce":787205513}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6835/721965507","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":721965507},{"type":"v1","addr":"10.20.193.127:6835","nonce":721965507}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6835/1936668239","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":1936668239},{"type":"v1","addr":"10.20.193.177:6835","nonce":1936668239}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6837/2542438956","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":2542438956},{"type":"v1","addr":"10.20.193.177:6837","nonce":2542438956}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6837/4252675734","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":4252675734},{"type":"v1","addr":"10.20.193.127:6837","nonce":4252675734}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6839/145347701","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":145347701},{"type":"v1","addr":"10.20.193.177:6839","nonce":145347701}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2026-02-13T03:45:18.298 INFO:teuthology.orchestra.run.trial070.stderr:dumped fsmap epoch 10 2026-02-13T03:45:18.299 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5c680b5680 msgr2=0x7f5c680d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:18.299 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5c680b5680 0x7f5c680d5b30 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c88004750 tx=0x7f5c88009260 comp rx=0 tx=0).stop 2026-02-13T03:45:18.299 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c94115410 msgr2=0x7f5c94175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:18.299 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c94115410 0x7f5c94175cb0 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c7c0023a0 tx=0x7f5c7c02fb70 comp rx=0 tx=0).stop 2026-02-13T03:45:18.299 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 shutdown_connections 2026-02-13T03:45:18.299 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5c680b5680 0x7f5c680d5b30 unknown :-1 s=CLOSED pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:18.299 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5c940f5320 0x7f5c940fa5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:18.299 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5c94115410 0x7f5c94175cb0 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:18.299 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 --2- 10.20.193.70:0/3643346499 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c9410f200 0x7f5c940f4cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:18.300 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 >> 10.20.193.70:0/3643346499 conn(0x7f5c940ecb00 msgr2=0x7f5c94111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:18.300 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 shutdown_connections 2026-02-13T03:45:18.300 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:18.296+0000 7f5c990216c0 1 -- 10.20.193.70:0/3643346499 wait complete. 2026-02-13T03:45:18.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.70:6838/1271943071,v1:10.20.193.70:6839/1271943071] up:boot 2026-02-13T03:45:18.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: fsmap 10 up:standby 2026-02-13T03:45:18.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T03:45:18.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:18.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:18.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:18.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:18.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:18.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:18.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:18 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3643346499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:18.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.70:6838/1271943071,v1:10.20.193.70:6839/1271943071] up:boot 2026-02-13T03:45:18.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: fsmap 10 up:standby 2026-02-13T03:45:18.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T03:45:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:18.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3643346499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:18.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.70:6838/1271943071,v1:10.20.193.70:6839/1271943071] up:boot 2026-02-13T03:45:18.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: fsmap 10 up:standby 2026-02-13T03:45:18.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T03:45:18.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:18.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:18.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:18.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T03:45:18.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T03:45:18.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:18.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3643346499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:18.724 INFO:journalctl@ceph.mds.b.trial127.stdout:Feb 13 03:45:18 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-b[55247]: starting mds.b at 2026-02-13T03:45:19.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.70:6840/3526910033,v1:10.20.193.70:6841/3526910033] up:boot 2026-02-13T03:45:19.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: fsmap 11 up:standby 2026-02-13T03:45:19.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T03:45:19.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:19.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:19.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.703 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:19 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.70:6840/3526910033,v1:10.20.193.70:6841/3526910033] up:boot 2026-02-13T03:45:19.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: fsmap 11 up:standby 2026-02-13T03:45:19.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.725 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:19 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.70:6840/3526910033,v1:10.20.193.70:6841/3526910033] up:boot 2026-02-13T03:45:19.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: fsmap 11 up:standby 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:19.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:19 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:20.343 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:45:20.462 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:20.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.587+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/400102542 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308115410 msgr2=0x7fd308175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:20.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.587+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/400102542 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308115410 0x7fd308175db0 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=6149594570552561775 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd30400aa70 tx=0x7fd30402fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/400102542 shutdown_connections 2026-02-13T03:45:20.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/400102542 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308115410 0x7fd308175db0 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=6149594570552561775 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/400102542 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd30810fbf0 0x7fd308114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.591 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/400102542 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd30810f200 0x7fd30810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.591 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/400102542 >> 10.20.193.70:0/400102542 conn(0x7fd3080ecb00 msgr2=0x7fd30810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:20.591 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/400102542 shutdown_connections 2026-02-13T03:45:20.591 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/400102542 wait complete. 2026-02-13T03:45:20.591 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.127:6838/4111425300,v1:10.20.193.127:6839/4111425300] up:boot 2026-02-13T03:45:20.591 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: fsmap 12 up:standby 2026-02-13T03:45:20.591 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T03:45:20.591 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:20.592 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:20.592 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:20.592 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:20.592 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:20.592 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:20.592 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:20 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:20.594 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 Processor -- start 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 -- start start 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd30810f200 0x7fd30811d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd308115410 0x7fd30811d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308122ad0 0x7fd308122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd3081234e0 con 0x7fd308122ad0 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd308123650 con 0x7fd308115410 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30f8bd6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd308123810 con 0x7fd30810f200 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30de2f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308122ad0 0x7fd308122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30de2f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308122ad0 0x7fd308122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52000/0 (socket says 10.20.193.70:52000) 2026-02-13T03:45:20.595 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30de2f6c0 1 -- 10.20.193.70:0/4117567822 learned_addr learned my addr 10.20.193.70:0/4117567822 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30ce2d6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd308115410 0x7fd30811d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30d62e6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd30810f200 0x7fd30811d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30de2f6c0 1 -- 10.20.193.70:0/4117567822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd30810f200 msgr2=0x7fd30811d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30de2f6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd30810f200 0x7fd30811d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30de2f6c0 1 -- 10.20.193.70:0/4117567822 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd308115410 msgr2=0x7fd30811d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30de2f6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd308115410 0x7fd30811d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30de2f6c0 1 -- 10.20.193.70:0/4117567822 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30400a660 con 0x7fd308122ad0 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.588+0000 7fd30de2f6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308122ad0 0x7fd308122f70 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3040054b0 tx=0x7fd3040054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.589+0000 7fd2f67fc6c0 1 -- 10.20.193.70:0/4117567822 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd304003a30 con 0x7fd308122ad0 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.589+0000 7fd2f67fc6c0 1 -- 10.20.193.70:0/4117567822 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd304003b90 con 0x7fd308122ad0 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.589+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd308163c60 con 0x7fd308122ad0 2026-02-13T03:45:20.596 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.589+0000 7fd2f67fc6c0 1 -- 10.20.193.70:0/4117567822 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3040382f0 con 0x7fd308122ad0 2026-02-13T03:45:20.597 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.589+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd308164090 con 0x7fd308122ad0 2026-02-13T03:45:20.597 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.589+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3081104d0 con 0x7fd308122ad0 2026-02-13T03:45:20.597 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.590+0000 7fd2f67fc6c0 1 -- 10.20.193.70:0/4117567822 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fd304008260 con 0x7fd308122ad0 2026-02-13T03:45:20.597 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.591+0000 7fd2f67fc6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2e40b5600 0x7fd2e40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:20.597 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.591+0000 7fd2f67fc6c0 1 -- 10.20.193.70:0/4117567822 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7fd304108960 con 0x7fd308122ad0 2026-02-13T03:45:20.597 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.591+0000 7fd30d62e6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2e40b5600 0x7fd2e40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:20.597 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.591+0000 7fd30d62e6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2e40b5600 0x7fd2e40d5ab0 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2f8005980 tx=0x7fd2f8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:20.597 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.592+0000 7fd2f67fc6c0 1 -- 10.20.193.70:0/4117567822 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd3040cb880 con 0x7fd308122ad0 2026-02-13T03:45:20.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.127:6838/4111425300,v1:10.20.193.127:6839/4111425300] up:boot 2026-02-13T03:45:20.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: fsmap 12 up:standby 2026-02-13T03:45:20.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T03:45:20.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:20.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:20.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:20.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:20.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:20.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:20.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:20 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.127:6838/4111425300,v1:10.20.193.127:6839/4111425300] up:boot 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: fsmap 12 up:standby 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:20.712 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:20 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:20.713 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.710+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd30810f5d0 con 0x7fd308122ad0 2026-02-13T03:45:20.713 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.711+0000 7fd2f67fc6c0 1 -- 10.20.193.70:0/4117567822 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+10529 (secure 0 0 0) 0x7fd3040cea30 con 0x7fd308122ad0 2026-02-13T03:45:20.714 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:20.714 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":12,"btime":"2026-02-13T03:45:19:329203+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6835/4222419180","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6834","nonce":4222419180},{"type":"v1","addr":"10.20.193.70:6835","nonce":4222419180}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6837/4178814163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6836","nonce":4178814163},{"type":"v1","addr":"10.20.193.70:6837","nonce":4178814163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6839/1271943071","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6838","nonce":1271943071},{"type":"v1","addr":"10.20.193.70:6839","nonce":1271943071}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6841/3526910033","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6840","nonce":3526910033},{"type":"v1","addr":"10.20.193.70:6841","nonce":3526910033}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/2607551184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":2607551184},{"type":"v1","addr":"10.20.193.127:6833","nonce":2607551184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/787205513","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":787205513},{"type":"v1","addr":"10.20.193.177:6833","nonce":787205513}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6835/721965507","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":721965507},{"type":"v1","addr":"10.20.193.127:6835","nonce":721965507}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6835/1936668239","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":1936668239},{"type":"v1","addr":"10.20.193.177:6835","nonce":1936668239}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6837/2542438956","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":2542438956},{"type":"v1","addr":"10.20.193.177:6837","nonce":2542438956}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6837/4252675734","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":4252675734},{"type":"v1","addr":"10.20.193.127:6837","nonce":4252675734}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6839/145347701","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":145347701},{"type":"v1","addr":"10.20.193.177:6839","nonce":145347701}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24494,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6839/4111425300","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":4111425300},{"type":"v1","addr":"10.20.193.127:6839","nonce":4111425300}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2026-02-13T03:45:20.715 INFO:teuthology.orchestra.run.trial070.stderr:dumped fsmap epoch 12 2026-02-13T03:45:20.715 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.712+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2e40b5600 msgr2=0x7fd2e40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:20.715 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.712+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2e40b5600 0x7fd2e40d5ab0 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2f8005980 tx=0x7fd2f8005910 comp rx=0 tx=0).stop 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308122ad0 msgr2=0x7fd308122f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308122ad0 0x7fd308122f70 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3040054b0 tx=0x7fd3040054e0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 shutdown_connections 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2e40b5600 0x7fd2e40d5ab0 unknown :-1 s=CLOSED pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd308122ad0 0x7fd308122f70 unknown :-1 s=CLOSED pgs=213 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd308115410 0x7fd30811d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 --2- 10.20.193.70:0/4117567822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd30810f200 0x7fd30811d1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 >> 10.20.193.70:0/4117567822 conn(0x7fd3080ecb00 msgr2=0x7fd30810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 shutdown_connections 2026-02-13T03:45:20.716 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:20.713+0000 7fd30f8bd6c0 1 -- 10.20.193.70:0/4117567822 wait complete. 2026-02-13T03:45:20.758 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-13T03:45:20.876 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:21.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4286405392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad810cfb0 msgr2=0x7f3ad810d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:21.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4286405392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad810cfb0 0x7f3ad810d380 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=15640069642842333285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3acc0099a0 tx=0x7f3acc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:21.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4286405392 shutdown_connections 2026-02-13T03:45:21.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4286405392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ad81131c0 0x7f3ad8173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4286405392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ad810d9a0 0x7f3ad81129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4286405392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad810cfb0 0x7f3ad810d380 unknown :-1 s=CLOSED pgs=214 gs=1 cs=0 l=1 c_cookie=15640069642842333285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4286405392 >> 10.20.193.70:0/4286405392 conn(0x7f3ad80ea8b0 msgr2=0x7f3ad810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4286405392 shutdown_connections 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4286405392 wait complete. 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 Processor -- start 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.000+0000 7f3add57d6c0 1 -- start start 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3add57d6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ad810cfb0 0x7f3ad8060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3add57d6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ad81131c0 0x7f3ad8060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3add57d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad8061180 0x7f3ad81633a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3add57d6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad81638e0 con 0x7f3ad8061180 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3add57d6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad8163a50 con 0x7f3ad810cfb0 2026-02-13T03:45:21.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3add57d6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad8163c10 con 0x7f3ad81131c0 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad77fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad8061180 0x7f3ad81633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad77fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad8061180 0x7f3ad81633a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52026/0 (socket says 10.20.193.70:52026) 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad77fe6c0 1 -- 10.20.193.70:0/4280788166 learned_addr learned my addr 10.20.193.70:0/4280788166 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad6ffd6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ad810cfb0 0x7f3ad8060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad67fc6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ad81131c0 0x7f3ad8060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad77fe6c0 1 -- 10.20.193.70:0/4280788166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ad81131c0 msgr2=0x7f3ad8060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad77fe6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ad81131c0 0x7f3ad8060c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad77fe6c0 1 -- 10.20.193.70:0/4280788166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ad810cfb0 msgr2=0x7f3ad8060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad77fe6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ad810cfb0 0x7f3ad8060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad77fe6c0 1 -- 10.20.193.70:0/4280788166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3acc009590 con 0x7f3ad8061180 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ad77fe6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad8061180 0x7f3ad81633a0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ac800c6c0 tx=0x7f3ac800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:21.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ab7fff6c0 1 -- 10.20.193.70:0/4280788166 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ac8003a30 con 0x7f3ad8061180 2026-02-13T03:45:21.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ab7fff6c0 1 -- 10.20.193.70:0/4280788166 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3ac80054e0 con 0x7f3ad8061180 2026-02-13T03:45:21.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3ab7fff6c0 1 -- 10.20.193.70:0/4280788166 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ac800dc50 con 0x7f3ad8061180 2026-02-13T03:45:21.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad8163ef0 con 0x7f3ad8061180 2026-02-13T03:45:21.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.001+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad81643d0 con 0x7f3ad8061180 2026-02-13T03:45:21.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.002+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad810e280 con 0x7f3ad8061180 2026-02-13T03:45:21.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.003+0000 7f3ab7fff6c0 1 -- 10.20.193.70:0/4280788166 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f3ac8005080 con 0x7f3ad8061180 2026-02-13T03:45:21.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.003+0000 7f3ab7fff6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3aac0b5680 0x7f3aac0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:21.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.004+0000 7f3ad6ffd6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3aac0b5680 0x7f3aac0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:21.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.004+0000 7f3ab7fff6c0 1 -- 10.20.193.70:0/4280788166 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7f3ac80e43b0 con 0x7f3ad8061180 2026-02-13T03:45:21.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.004+0000 7f3ab7fff6c0 1 -- 10.20.193.70:0/4280788166 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3ac80aad30 con 0x7f3ad8061180 2026-02-13T03:45:21.009 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.004+0000 7f3ad6ffd6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3aac0b5680 0x7f3aac0d5b30 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3acc005b40 tx=0x7f3acc0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:21.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.099+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3ad8061a00 con 0x7f3ad8061180 2026-02-13T03:45:21.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.099+0000 7f3ab7fff6c0 1 -- 10.20.193.70:0/4280788166 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) ==== 84+0+65 (secure 0 0 0) 0x7f3ac80a9820 con 0x7f3ad8061180 2026-02-13T03:45:21.101 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:21.102 INFO:teuthology.orchestra.run.trial070.stdout:[ 2026-02-13T03:45:21.102 INFO:teuthology.orchestra.run.trial070.stdout: { 2026-02-13T03:45:21.102 INFO:teuthology.orchestra.run.trial070.stdout: "poolnum": 1, 2026-02-13T03:45:21.102 INFO:teuthology.orchestra.run.trial070.stdout: "poolname": ".mgr" 2026-02-13T03:45:21.102 INFO:teuthology.orchestra.run.trial070.stdout: } 2026-02-13T03:45:21.102 INFO:teuthology.orchestra.run.trial070.stdout:] 2026-02-13T03:45:21.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3aac0b5680 msgr2=0x7f3aac0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:21.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3aac0b5680 0x7f3aac0d5b30 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3acc005b40 tx=0x7f3acc0023a0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad8061180 msgr2=0x7f3ad81633a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:21.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad8061180 0x7f3ad81633a0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ac800c6c0 tx=0x7f3ac800cb90 comp rx=0 tx=0).stop 2026-02-13T03:45:21.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 shutdown_connections 2026-02-13T03:45:21.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3aac0b5680 0x7f3aac0d5b30 unknown :-1 s=CLOSED pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3ad8061180 0x7f3ad81633a0 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ad81131c0 0x7f3ad8060c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 --2- 10.20.193.70:0/4280788166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3ad810cfb0 0x7f3ad8060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 >> 10.20.193.70:0/4280788166 conn(0x7f3ad80ea8b0 msgr2=0x7f3ad810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:21.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 shutdown_connections 2026-02-13T03:45:21.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.101+0000 7f3add57d6c0 1 -- 10.20.193.70:0/4280788166 wait complete. 2026-02-13T03:45:21.148 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-13T03:45:21.149 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-13T03:45:21.267 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:21.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.383+0000 7f4a13a456c0 1 -- 10.20.193.70:0/3645907434 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 msgr2=0x7f4a0c10be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:21.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.383+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/3645907434 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 0x7f4a0c10be40 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=7938849320217761651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49fc009970 tx=0x7f49fc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:21.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.383+0000 7f4a13a456c0 1 -- 10.20.193.70:0/3645907434 shutdown_connections 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.383+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/3645907434 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a0c1557a0 0x7f4a0c175b80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.383+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/3645907434 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a0c10c380 0x7f4a0c155260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.383+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/3645907434 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 0x7f4a0c10be40 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=7938849320217761651 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.383+0000 7f4a13a456c0 1 -- 10.20.193.70:0/3645907434 >> 10.20.193.70:0/3645907434 conn(0x7f4a0c0e9770 msgr2=0x7f4a0c109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.383+0000 7f4a13a456c0 1 -- 10.20.193.70:0/3645907434 shutdown_connections 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.383+0000 7f4a13a456c0 1 -- 10.20.193.70:0/3645907434 wait complete. 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 Processor -- start 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 -- start start 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 0x7f4a0c160570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a0c10c380 0x7f4a0c160ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:21.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a0c1557a0 0x7f4a0c165e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1664c0 con 0x7f4a0c10ba70 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c166630 con 0x7f4a0c1557a0 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0c1667f0 con 0x7f4a0c10c380 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a117b66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 0x7f4a0c160570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a117b66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 0x7f4a0c160570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52052/0 (socket says 10.20.193.70:52052) 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a117b66c0 1 -- 10.20.193.70:0/153758952 learned_addr learned my addr 10.20.193.70:0/153758952 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a10fb56c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a0c10c380 0x7f4a0c160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a11fb76c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a0c1557a0 0x7f4a0c165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a117b66c0 1 -- 10.20.193.70:0/153758952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a0c10c380 msgr2=0x7f4a0c160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a117b66c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a0c10c380 0x7f4a0c160ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a117b66c0 1 -- 10.20.193.70:0/153758952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a0c1557a0 msgr2=0x7f4a0c165e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a117b66c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a0c1557a0 0x7f4a0c165e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a117b66c0 1 -- 10.20.193.70:0/153758952 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49fc009590 con 0x7f4a0c10ba70 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a11fb76c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a0c1557a0 0x7f4a0c165e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a117b66c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 0x7f4a0c160570 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49fc031fd0 tx=0x7f49fc02fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f49fa7fc6c0 1 -- 10.20.193.70:0/153758952 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49fc002ba0 con 0x7f4a0c10ba70 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f49fa7fc6c0 1 -- 10.20.193.70:0/153758952 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f49fc002d00 con 0x7f4a0c10ba70 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f49fa7fc6c0 1 -- 10.20.193.70:0/153758952 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49fc0372f0 con 0x7f4a0c10ba70 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0c166a70 con 0x7f4a0c10ba70 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.384+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a0c166cf0 con 0x7f4a0c10ba70 2026-02-13T03:45:21.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.385+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0c05fb30 con 0x7f4a0c10ba70 2026-02-13T03:45:21.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.386+0000 7f49fa7fc6c0 1 -- 10.20.193.70:0/153758952 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f49fc0071c0 con 0x7f4a0c10ba70 2026-02-13T03:45:21.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.387+0000 7f49fa7fc6c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49e80b5680 0x7f49e80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:21.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.387+0000 7f49fa7fc6c0 1 -- 10.20.193.70:0/153758952 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7f49fc107980 con 0x7f4a0c10ba70 2026-02-13T03:45:21.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.387+0000 7f4a10fb56c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49e80b5680 0x7f49e80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:21.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.387+0000 7f4a10fb56c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49e80b5680 0x7f49e80d5b30 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a00006b60 tx=0x7f4a00006af0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:21.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.387+0000 7f49fa7fc6c0 1 -- 10.20.193.70:0/153758952 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f49fc0ca8f0 con 0x7f4a0c10ba70 2026-02-13T03:45:21.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:21.482+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4a0c10be40 con 0x7f4a0c10ba70 2026-02-13T03:45:21.484 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:21.484 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:21.484 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4117567822' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:21.484 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4280788166' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T03:45:21.484 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:21.485 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:21.486 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:21.591 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:21.591 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:21.591 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4117567822' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:21.591 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4280788166' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T03:45:21.591 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.591 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:21.592 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:21.593 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:21.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:21.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4117567822' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4280788166' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:45:21.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:21.725 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:21.725 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:45:21.725 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:45:21.725 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:45:22.339 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.336+0000 7f49fa7fc6c0 1 -- 10.20.193.70:0/153758952 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) ==== 138+0+0 (secure 0 0 0) 0x7f49fc0cda10 con 0x7f4a0c10ba70 2026-02-13T03:45:22.339 INFO:teuthology.orchestra.run.trial070.stderr:pool 'cephfs_metadata' created 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49e80b5680 msgr2=0x7f49e80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49e80b5680 0x7f49e80d5b30 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a00006b60 tx=0x7f4a00006af0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 msgr2=0x7f4a0c160570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 0x7f4a0c160570 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49fc031fd0 tx=0x7f49fc02fcc0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 shutdown_connections 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49e80b5680 0x7f49e80d5b30 unknown :-1 s=CLOSED pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4a0c1557a0 0x7f4a0c165e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a0c10c380 0x7f4a0c160ab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 --2- 10.20.193.70:0/153758952 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4a0c10ba70 0x7f4a0c160570 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 >> 10.20.193.70:0/153758952 conn(0x7f4a0c0e9770 msgr2=0x7f4a0c109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 shutdown_connections 2026-02-13T03:45:22.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.341+0000 7f4a13a456c0 1 -- 10.20.193.70:0/153758952 wait complete. 2026-02-13T03:45:22.386 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-13T03:45:22.508 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:22.624 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:22 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/153758952' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T03:45:22.624 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:22 trial070 ceph-mon[24757]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:22.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 -- 10.20.193.70:0/3985815881 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc64010f230 msgr2=0x7fc64010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:22.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/3985815881 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc64010f230 0x7fc64010f600 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=3813850695970876732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6300099a0 tx=0x7fc63002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:22.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 -- 10.20.193.70:0/3985815881 shutdown_connections 2026-02-13T03:45:22.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/3985815881 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc640115440 0x7fc640175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/3985815881 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc64010fc20 0x7fc640114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/3985815881 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc64010f230 0x7fc64010f600 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=3813850695970876732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 -- 10.20.193.70:0/3985815881 >> 10.20.193.70:0/3985815881 conn(0x7fc6400ecb30 msgr2=0x7fc64010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:22.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 -- 10.20.193.70:0/3985815881 shutdown_connections 2026-02-13T03:45:22.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 -- 10.20.193.70:0/3985815881 wait complete. 2026-02-13T03:45:22.634 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 Processor -- start 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.629+0000 7fc646fd46c0 1 -- start start 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc646fd46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc64010f230 0x7fc64011d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc646fd46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc640115440 0x7fc64011d810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc646fd46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc640122bd0 0x7fc640123070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc646fd46c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc6401235e0 con 0x7fc640122bd0 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc646fd46c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc640123750 con 0x7fc64010f230 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc646fd46c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc640123910 con 0x7fc640115440 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc64554a6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc640122bd0 0x7fc640123070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc64554a6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc640122bd0 0x7fc640123070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52076/0 (socket says 10.20.193.70:52076) 2026-02-13T03:45:22.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc64554a6c0 1 -- 10.20.193.70:0/1993385901 learned_addr learned my addr 10.20.193.70:0/1993385901 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc644d496c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc64010f230 0x7fc64011d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc637fff6c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc640115440 0x7fc64011d810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc64554a6c0 1 -- 10.20.193.70:0/1993385901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc640115440 msgr2=0x7fc64011d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc64554a6c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc640115440 0x7fc64011d810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc64554a6c0 1 -- 10.20.193.70:0/1993385901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc64010f230 msgr2=0x7fc64011d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc64554a6c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc64010f230 0x7fc64011d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc64554a6c0 1 -- 10.20.193.70:0/1993385901 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc630009590 con 0x7fc640122bd0 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc64554a6c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc640122bd0 0x7fc640123070 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc63c006ea0 tx=0x7fc63c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc635ffb6c0 1 -- 10.20.193.70:0/1993385901 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc63c003a30 con 0x7fc640122bd0 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc635ffb6c0 1 -- 10.20.193.70:0/1993385901 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc63c0054f0 con 0x7fc640122bd0 2026-02-13T03:45:22.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc640163dc0 con 0x7fc640122bd0 2026-02-13T03:45:22.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc635ffb6c0 1 -- 10.20.193.70:0/1993385901 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc63c00dcd0 con 0x7fc640122bd0 2026-02-13T03:45:22.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc640164250 con 0x7fc640122bd0 2026-02-13T03:45:22.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.630+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc640110500 con 0x7fc640122bd0 2026-02-13T03:45:22.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.632+0000 7fc635ffb6c0 1 -- 10.20.193.70:0/1993385901 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fc63c005030 con 0x7fc640122bd0 2026-02-13T03:45:22.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.632+0000 7fc635ffb6c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc61c0b5680 0x7fc61c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:22.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.633+0000 7fc635ffb6c0 1 -- 10.20.193.70:0/1993385901 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7277+0+0 (secure 0 0 0) 0x7fc63c0e4860 con 0x7fc640122bd0 2026-02-13T03:45:22.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.633+0000 7fc644d496c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc61c0b5680 0x7fc61c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:22.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.633+0000 7fc635ffb6c0 1 -- 10.20.193.70:0/1993385901 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc63c0a7610 con 0x7fc640122bd0 2026-02-13T03:45:22.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.633+0000 7fc644d496c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc61c0b5680 0x7fc61c0d5b30 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6300092e0 tx=0x7fc630005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:22.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:22 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/153758952' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T03:45:22.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:22 trial177 ceph-mon[27082]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:22.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:22 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/153758952' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T03:45:22.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:22 trial127 ceph-mon[26439]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:22.728 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:22.726+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc64010f600 con 0x7fc640122bd0 2026-02-13T03:45:23.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.342+0000 7fc635ffb6c0 1 -- 10.20.193.70:0/1993385901 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) ==== 170+0+0 (secure 0 0 0) 0x7fc63c0aa7c0 con 0x7fc640122bd0 2026-02-13T03:45:23.344 INFO:teuthology.orchestra.run.trial070.stderr:pool 'cephfs_data' created 2026-02-13T03:45:23.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc61c0b5680 msgr2=0x7fc61c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:23.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc61c0b5680 0x7fc61c0d5b30 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6300092e0 tx=0x7fc630005c00 comp rx=0 tx=0).stop 2026-02-13T03:45:23.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc640122bd0 msgr2=0x7fc640123070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:23.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc640122bd0 0x7fc640123070 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc63c006ea0 tx=0x7fc63c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.347 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 shutdown_connections 2026-02-13T03:45:23.347 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc61c0b5680 0x7fc61c0d5b30 unknown :-1 s=CLOSED pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.348 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc640122bd0 0x7fc640123070 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.348 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc640115440 0x7fc64011d810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.348 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 --2- 10.20.193.70:0/1993385901 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc64010f230 0x7fc64011d2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.348 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.345+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 >> 10.20.193.70:0/1993385901 conn(0x7fc6400ecb30 msgr2=0x7fc64010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:23.348 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.346+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 shutdown_connections 2026-02-13T03:45:23.349 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.347+0000 7fc646fd46c0 1 -- 10.20.193.70:0/1993385901 wait complete. 2026-02-13T03:45:23.393 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-13T03:45:23.511 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:23.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/249579197 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810ed10 msgr2=0x7f004810f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:23.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/249579197 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810ed10 0x7f004810f1b0 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=14380073805907968657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003800aa40 tx=0x7f003802fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/249579197 shutdown_connections 2026-02-13T03:45:23.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/249579197 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810ed10 0x7f004810f1b0 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=14380073805907968657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/249579197 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f004810bc70 0x7f004810e640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/249579197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f004810b360 0x7f004810b730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/249579197 >> 10.20.193.70:0/249579197 conn(0x7f0048062e00 msgr2=0x7f0048109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:23.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/249579197 shutdown_connections 2026-02-13T03:45:23.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/249579197 wait complete. 2026-02-13T03:45:23.627 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:23 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/153758952' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T03:45:23.627 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:23 trial070 ceph-mon[24757]: osdmap e67: 12 total, 12 up, 12 in 2026-02-13T03:45:23.627 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:23 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1993385901' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T03:45:23.627 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:23.629 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 Processor -- start 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.623+0000 7f004d2bb6c0 1 -- start start 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f004d2bb6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810b360 0x7f0048122460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f004d2bb6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f004810bc70 0x7f00481229a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f004d2bb6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f004810ed10 0x7f0048127d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f004d2bb6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00481283b0 con 0x7f004810b360 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f004d2bb6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0048128520 con 0x7f004810ed10 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f004d2bb6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f00481286e0 con 0x7f004810bc70 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0046ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810b360 0x7f0048122460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0046ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810b360 0x7f0048122460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52102/0 (socket says 10.20.193.70:52102) 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0046ffd6c0 1 -- 10.20.193.70:0/2112883744 learned_addr learned my addr 10.20.193.70:0/2112883744 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:23.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f00467fc6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f004810bc70 0x7f00481229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0046ffd6c0 1 -- 10.20.193.70:0/2112883744 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f004810bc70 msgr2=0x7f00481229a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0046ffd6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f004810bc70 0x7f00481229a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0046ffd6c0 1 -- 10.20.193.70:0/2112883744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f004810ed10 msgr2=0x7f0048127d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0046ffd6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f004810ed10 0x7f0048127d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0046ffd6c0 1 -- 10.20.193.70:0/2112883744 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003800a660 con 0x7f004810b360 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0046ffd6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810b360 0x7f0048122460 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003c005dc0 tx=0x7f003c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0027fff6c0 1 -- 10.20.193.70:0/2112883744 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f003c004250 con 0x7f004810b360 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0027fff6c0 1 -- 10.20.193.70:0/2112883744 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f003c009070 con 0x7f004810b360 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00481289c0 con 0x7f004810b360 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f0027fff6c0 1 -- 10.20.193.70:0/2112883744 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f003c00cd70 con 0x7f004810b360 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00481690a0 con 0x7f004810b360 2026-02-13T03:45:23.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.624+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f004810c130 con 0x7f004810b360 2026-02-13T03:45:23.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.626+0000 7f0027fff6c0 1 -- 10.20.193.70:0/2112883744 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f003c0028c0 con 0x7f004810b360 2026-02-13T03:45:23.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.627+0000 7f0027fff6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f001c0b5680 0x7f001c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:23.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.627+0000 7f0027fff6c0 1 -- 10.20.193.70:0/2112883744 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7662+0+0 (secure 0 0 0) 0x7f003c0e3890 con 0x7f004810b360 2026-02-13T03:45:23.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.627+0000 7f00467fc6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f001c0b5680 0x7f001c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:23.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.627+0000 7f0027fff6c0 1 -- 10.20.193.70:0/2112883744 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f003c0a9450 con 0x7f004810b360 2026-02-13T03:45:23.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.627+0000 7f00467fc6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f001c0b5680 0x7f001c0d5b30 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0030005e50 tx=0x7f0030005de0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:23.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:23 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/153758952' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T03:45:23.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:23 trial177 ceph-mon[27082]: osdmap e67: 12 total, 12 up, 12 in 2026-02-13T03:45:23.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:23 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1993385901' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T03:45:23.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:23.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:23 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/153758952' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T03:45:23.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:23 trial127 ceph-mon[26439]: osdmap e67: 12 total, 12 up, 12 in 2026-02-13T03:45:23.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:23 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1993385901' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T03:45:23.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:45:23.746 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:23.744+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f004810b730 con 0x7f004810b360 2026-02-13T03:45:24.350 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.348+0000 7f0027fff6c0 1 -- 10.20.193.70:0/2112883744 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v13) ==== 172+0+0 (secure 0 0 0) 0x7f003c0a9630 con 0x7f004810b360 2026-02-13T03:45:24.351 INFO:teuthology.orchestra.run.trial070.stderr:new fs with metadata pool 2 and data pool 3 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f001c0b5680 msgr2=0x7f001c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f001c0b5680 0x7f001c0d5b30 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0030005e50 tx=0x7f0030005de0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810b360 msgr2=0x7f0048122460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810b360 0x7f0048122460 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003c005dc0 tx=0x7f003c00bbb0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 shutdown_connections 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f001c0b5680 0x7f001c0d5b30 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f004810ed10 0x7f0048127d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f004810bc70 0x7f00481229a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 --2- 10.20.193.70:0/2112883744 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f004810b360 0x7f0048122460 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 >> 10.20.193.70:0/2112883744 conn(0x7f0048062e00 msgr2=0x7f004810d930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:24.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.351+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 shutdown_connections 2026-02-13T03:45:24.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.352+0000 7f004d2bb6c0 1 -- 10.20.193.70:0/2112883744 wait complete. 2026-02-13T03:45:24.397 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:45:24.513 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:24.628 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:24 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1993385901' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T03:45:24.629 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:24 trial070 ceph-mon[24757]: osdmap e68: 12 total, 12 up, 12 in 2026-02-13T03:45:24.629 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:24 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2112883744' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T03:45:24.629 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:24 trial070 ceph-mon[24757]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T03:45:24.629 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:24 trial070 ceph-mon[24757]: pgmap v184: 97 pgs: 8 creating+peering, 79 unknown, 10 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:24.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 -- 10.20.193.70:0/3598292032 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f838810fc20 msgr2=0x7f8388114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:24.635 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 --2- 10.20.193.70:0/3598292032 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f838810fc20 0x7f8388114c60 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=11693489975515086669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83700099a0 tx=0x7f837002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 -- 10.20.193.70:0/3598292032 shutdown_connections 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 --2- 10.20.193.70:0/3598292032 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8388115440 0x7f8388175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 --2- 10.20.193.70:0/3598292032 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f838810fc20 0x7f8388114c60 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=11693489975515086669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 --2- 10.20.193.70:0/3598292032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838810f230 0x7f838810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 -- 10.20.193.70:0/3598292032 >> 10.20.193.70:0/3598292032 conn(0x7f83880ecb30 msgr2=0x7f838810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 -- 10.20.193.70:0/3598292032 shutdown_connections 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 -- 10.20.193.70:0/3598292032 wait complete. 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 Processor -- start 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.631+0000 7f838efd06c0 1 -- start start 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838efd06c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838810f230 0x7f83880f4cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:24.636 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838efd06c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8388115440 0x7f8388175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838efd06c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83880f52f0 0x7f83880fa5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838efd06c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83880f59e0 con 0x7f8388115440 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838efd06c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f83880fab00 con 0x7f83880f52f0 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838efd06c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83880facc0 con 0x7f838810f230 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8388115440 0x7f8388175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8388115440 0x7f8388175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52124/0 (socket says 10.20.193.70:52124) 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837ffff6c0 1 -- 10.20.193.70:0/1205790909 learned_addr learned my addr 10.20.193.70:0/1205790909 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838cd456c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838810f230 0x7f83880f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837ffff6c0 1 -- 10.20.193.70:0/1205790909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838810f230 msgr2=0x7f83880f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837ffff6c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838810f230 0x7f83880f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.637 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838d5466c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83880f52f0 0x7f83880fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837ffff6c0 1 -- 10.20.193.70:0/1205790909 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83880f52f0 msgr2=0x7f83880fa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837ffff6c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83880f52f0 0x7f83880fa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837ffff6c0 1 -- 10.20.193.70:0/1205790909 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8370009590 con 0x7f8388115440 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838d5466c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83880f52f0 0x7f83880fa5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837ffff6c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8388115440 0x7f8388175ce0 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8370004830 tx=0x7f837002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837dffb6c0 1 -- 10.20.193.70:0/1205790909 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8370002ae0 con 0x7f8388115440 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837dffb6c0 1 -- 10.20.193.70:0/1205790909 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8370002c40 con 0x7f8388115440 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83880faf40 con 0x7f8388115440 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f837dffb6c0 1 -- 10.20.193.70:0/1205790909 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f83700362f0 con 0x7f8388115440 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.632+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83880fb3e0 con 0x7f8388115440 2026-02-13T03:45:24.638 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.633+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8388110500 con 0x7f8388115440 2026-02-13T03:45:24.639 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.634+0000 7f837dffb6c0 1 -- 10.20.193.70:0/1205790909 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f8370007810 con 0x7f8388115440 2026-02-13T03:45:24.639 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.634+0000 7f837dffb6c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83640b5680 0x7f83640d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:24.640 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.635+0000 7f838cd456c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83640b5680 0x7f83640d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:24.640 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.635+0000 7f837dffb6c0 1 -- 10.20.193.70:0/1205790909 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7762+0+0 (secure 0 0 0) 0x7f8370107a60 con 0x7f8388115440 2026-02-13T03:45:24.640 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.635+0000 7f838cd456c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83640b5680 0x7f83640d5b30 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8378005980 tx=0x7f8378005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:24.640 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.635+0000 7f837dffb6c0 1 -- 10.20.193.70:0/1205790909 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f83700ca620 con 0x7f8388115440 2026-02-13T03:45:24.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:24 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1993385901' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T03:45:24.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:24 trial177 ceph-mon[27082]: osdmap e68: 12 total, 12 up, 12 in 2026-02-13T03:45:24.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:24 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2112883744' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T03:45:24.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:24 trial177 ceph-mon[27082]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T03:45:24.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:24 trial177 ceph-mon[27082]: pgmap v184: 97 pgs: 8 creating+peering, 79 unknown, 10 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:24.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:24 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1993385901' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T03:45:24.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:24 trial127 ceph-mon[26439]: osdmap e68: 12 total, 12 up, 12 in 2026-02-13T03:45:24.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:24 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2112883744' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T03:45:24.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:24 trial127 ceph-mon[26439]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T03:45:24.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:24 trial127 ceph-mon[26439]: pgmap v184: 97 pgs: 8 creating+peering, 79 unknown, 10 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T03:45:24.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.728+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f838810fc20 con 0x7f8388115440 2026-02-13T03:45:24.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.729+0000 7f837dffb6c0 1 -- 10.20.193.70:0/1205790909 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+22073 (secure 0 0 0) 0x7f83700cd7d0 con 0x7f8388115440 2026-02-13T03:45:24.731 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:24.732 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":69,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","created":"2026-02-13T03:42:55.979106+0000","modified":"2026-02-13T03:45:23.746377+0000","last_up_change":"2026-02-13T03:45:06.144024+0000","last_in_change":"2026-02-13T03:44:57.854565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:43:58.913146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:45:21.488475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:45:22.732576+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76aee801-8323-41e6-8540-7d0b5fa666e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6802","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6803","nonce":1468748446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6804","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6805","nonce":1468748446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6808","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6809","nonce":1468748446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6806","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6807","nonce":1468748446}]},"public_addr":"10.20.193.70:6803/1468748446","cluster_addr":"10.20.193.70:6805/1468748446","heartbeat_back_addr":"10.20.193.70:6809/1468748446","heartbeat_front_addr":"10.20.193.70:6807/1468748446","state":["exists","up"]},{"osd":1,"uuid":"621ea3ce-4cd8-4150-a1ba-f4e189f680bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6801","nonce":3454251527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6803","nonce":3454251527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6807","nonce":3454251527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6805","nonce":3454251527}]},"public_addr":"10.20.193.127:6801/3454251527","cluster_addr":"10.20.193.127:6803/3454251527","heartbeat_back_addr":"10.20.193.127:6807/3454251527","heartbeat_front_addr":"10.20.193.127:6805/3454251527","state":["exists","up"]},{"osd":2,"uuid":"17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6801","nonce":2599066943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6803","nonce":2599066943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6807","nonce":2599066943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6805","nonce":2599066943}]},"public_addr":"10.20.193.177:6801/2599066943","cluster_addr":"10.20.193.177:6803/2599066943","heartbeat_back_addr":"10.20.193.177:6807/2599066943","heartbeat_front_addr":"10.20.193.177:6805/2599066943","state":["exists","up"]},{"osd":3,"uuid":"31edcb70-f683-4525-b2c3-348788484124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6810","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6811","nonce":3715748086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6812","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6813","nonce":3715748086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6816","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6817","nonce":3715748086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6814","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6815","nonce":3715748086}]},"public_addr":"10.20.193.70:6811/3715748086","cluster_addr":"10.20.193.70:6813/3715748086","heartbeat_back_addr":"10.20.193.70:6817/3715748086","heartbeat_front_addr":"10.20.193.70:6815/3715748086","state":["exists","up"]},{"osd":4,"uuid":"82a40ce4-8f67-4a58-b08d-d7bfdbd447ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6809","nonce":2954348410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6811","nonce":2954348410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6815","nonce":2954348410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6813","nonce":2954348410}]},"public_addr":"10.20.193.127:6809/2954348410","cluster_addr":"10.20.193.127:6811/2954348410","heartbeat_back_addr":"10.20.193.127:6815/2954348410","heartbeat_front_addr":"10.20.193.127:6813/2954348410","state":["exists","up"]},{"osd":5,"uuid":"f96cee85-6197-423b-a006-6d2d85772d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6809","nonce":2878984246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6811","nonce":2878984246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6815","nonce":2878984246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6813","nonce":2878984246}]},"public_addr":"10.20.193.177:6809/2878984246","cluster_addr":"10.20.193.177:6811/2878984246","heartbeat_back_addr":"10.20.193.177:6815/2878984246","heartbeat_front_addr":"10.20.193.177:6813/2878984246","state":["exists","up"]},{"osd":6,"uuid":"8703f159-2f0c-4744-8797-960d48eedfc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6818","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6819","nonce":192941608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6820","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6821","nonce":192941608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6824","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6825","nonce":192941608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6822","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6823","nonce":192941608}]},"public_addr":"10.20.193.70:6819/192941608","cluster_addr":"10.20.193.70:6821/192941608","heartbeat_back_addr":"10.20.193.70:6825/192941608","heartbeat_front_addr":"10.20.193.70:6823/192941608","state":["exists","up"]},{"osd":7,"uuid":"7203c134-bbbb-4980-b512-a49cb17481d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6817","nonce":3503194265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6819","nonce":3503194265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6823","nonce":3503194265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6821","nonce":3503194265}]},"public_addr":"10.20.193.127:6817/3503194265","cluster_addr":"10.20.193.127:6819/3503194265","heartbeat_back_addr":"10.20.193.127:6823/3503194265","heartbeat_front_addr":"10.20.193.127:6821/3503194265","state":["exists","up"]},{"osd":8,"uuid":"1771e760-778b-4f83-a0c5-12eeee43c768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6817","nonce":2623744285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6819","nonce":2623744285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6823","nonce":2623744285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6821","nonce":2623744285}]},"public_addr":"10.20.193.177:6817/2623744285","cluster_addr":"10.20.193.177:6819/2623744285","heartbeat_back_addr":"10.20.193.177:6823/2623744285","heartbeat_front_addr":"10.20.193.177:6821/2623744285","state":["exists","up"]},{"osd":9,"uuid":"2ad7ff96-14be-4cb9-9b52-1a00e064de38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6826","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6827","nonce":1992888403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6828","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6829","nonce":1992888403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6832","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6833","nonce":1992888403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6830","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6831","nonce":1992888403}]},"public_addr":"10.20.193.70:6827/1992888403","cluster_addr":"10.20.193.70:6829/1992888403","heartbeat_back_addr":"10.20.193.70:6833/1992888403","heartbeat_front_addr":"10.20.193.70:6831/1992888403","state":["exists","up"]},{"osd":10,"uuid":"3ca6791a-ad2b-4701-a67d-17e83888b9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6825","nonce":380098770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6827","nonce":380098770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6831","nonce":380098770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6829","nonce":380098770}]},"public_addr":"10.20.193.127:6825/380098770","cluster_addr":"10.20.193.127:6827/380098770","heartbeat_back_addr":"10.20.193.127:6831/380098770","heartbeat_front_addr":"10.20.193.127:6829/380098770","state":["exists","up"]},{"osd":11,"uuid":"0d51bb23-8f23-43b5-b697-ca294fd39e89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6825","nonce":3785556542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6827","nonce":3785556542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6831","nonce":3785556542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6829","nonce":3785556542}]},"public_addr":"10.20.193.177:6825/3785556542","cluster_addr":"10.20.193.177:6827/3785556542","heartbeat_back_addr":"10.20.193.177:6831/3785556542","heartbeat_front_addr":"10.20.193.177:6829/3785556542","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:43.223664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:50.561682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:57.716321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:05.230108+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:12.548595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:19.918131+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:27.198884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:34.668843+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:42.036449+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:49.563635+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:57.025291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:45:04.376713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.70:6801/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:6800/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/1475427018":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/2220510112":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/3723878791":"2026-02-14T03:43:02.018661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.730+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83640b5680 msgr2=0x7f83640d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.730+0000 7f838efd06c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83640b5680 0x7f83640d5b30 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8378005980 tx=0x7f8378005910 comp rx=0 tx=0).stop 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.730+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8388115440 msgr2=0x7f8388175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.730+0000 7f838efd06c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8388115440 0x7f8388175ce0 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8370004830 tx=0x7f837002fbf0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.731+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 shutdown_connections 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.731+0000 7f838efd06c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83640b5680 0x7f83640d5b30 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.731+0000 7f838efd06c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f83880f52f0 0x7f83880fa5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.731+0000 7f838efd06c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8388115440 0x7f8388175ce0 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.731+0000 7f838efd06c0 1 --2- 10.20.193.70:0/1205790909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838810f230 0x7f83880f4cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:24.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.731+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 >> 10.20.193.70:0/1205790909 conn(0x7f83880ecb30 msgr2=0x7f838810d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:24.734 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.731+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 shutdown_connections 2026-02-13T03:45:24.734 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:24.731+0000 7f838efd06c0 1 -- 10.20.193.70:0/1205790909 wait complete. 2026-02-13T03:45:24.774 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:45:24.891 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:25.009 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.005+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/3903063391 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 msgr2=0x7f8ae0155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:25.009 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.005+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/3903063391 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 0x7f8ae0155260 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=5982212891929331341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ac8009970 tx=0x7f8ac802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:25.009 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.005+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/3903063391 shutdown_connections 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.005+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/3903063391 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ae01557a0 0x7f8ae0175b80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.005+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/3903063391 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 0x7f8ae0155260 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=5982212891929331341 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.005+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/3903063391 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ae010ba70 0x7f8ae010be40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.005+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/3903063391 >> 10.20.193.70:0/3903063391 conn(0x7f8ae00e9770 msgr2=0x7f8ae0109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.005+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/3903063391 shutdown_connections 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.005+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/3903063391 wait complete. 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 Processor -- start 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 -- start start 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ae010ba70 0x7f8ae0160570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 0x7f8ae0160ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:25.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ae01557a0 0x7f8ae0165e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae01664c0 con 0x7f8ae010c380 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae0166630 con 0x7f8ae010ba70 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae01667f0 con 0x7f8ae01557a0 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ade7fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 0x7f8ae0160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ade7fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 0x7f8ae0160ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52140/0 (socket says 10.20.193.70:52140) 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ade7fc6c0 1 -- 10.20.193.70:0/2274939754 learned_addr learned my addr 10.20.193.70:0/2274939754 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8adeffd6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ae010ba70 0x7f8ae0160570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8adf7fe6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ae01557a0 0x7f8ae0165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ade7fc6c0 1 -- 10.20.193.70:0/2274939754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ae01557a0 msgr2=0x7f8ae0165e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ade7fc6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ae01557a0 0x7f8ae0165e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ade7fc6c0 1 -- 10.20.193.70:0/2274939754 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ae010ba70 msgr2=0x7f8ae0160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:25.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ade7fc6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ae010ba70 0x7f8ae0160570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ade7fc6c0 1 -- 10.20.193.70:0/2274939754 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac8009590 con 0x7f8ae010c380 2026-02-13T03:45:25.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ade7fc6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 0x7f8ae0160ab0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ac80092b0 tx=0x7f8ac802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:25.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae48d66c0 1 -- 10.20.193.70:0/2274939754 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ac8002c20 con 0x7f8ae010c380 2026-02-13T03:45:25.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae48d66c0 1 -- 10.20.193.70:0/2274939754 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8ac8002d80 con 0x7f8ae010c380 2026-02-13T03:45:25.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae0166a70 con 0x7f8ae010c380 2026-02-13T03:45:25.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae48d66c0 1 -- 10.20.193.70:0/2274939754 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ac80372f0 con 0x7f8ae010c380 2026-02-13T03:45:25.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.006+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae01523e0 con 0x7f8ae010c380 2026-02-13T03:45:25.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.007+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae005fb30 con 0x7f8ae010c380 2026-02-13T03:45:25.013 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.008+0000 7f8ae48d66c0 1 -- 10.20.193.70:0/2274939754 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f8ac80079a0 con 0x7f8ae010c380 2026-02-13T03:45:25.013 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.009+0000 7f8ae48d66c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8ab40b5600 0x7f8ab40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:25.013 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.009+0000 7f8ae48d66c0 1 -- 10.20.193.70:0/2274939754 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7762+0+0 (secure 0 0 0) 0x7f8ac8107cd0 con 0x7f8ae010c380 2026-02-13T03:45:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.009+0000 7f8adeffd6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8ab40b5600 0x7f8ab40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.009+0000 7f8adeffd6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8ab40b5600 0x7f8ab40d5ab0 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ad4006b60 tx=0x7f8ad4006af0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.009+0000 7f8ae48d66c0 1 -- 10.20.193.70:0/2274939754 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8ac80ca920 con 0x7f8ae010c380 2026-02-13T03:45:25.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.104+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ae01616c0 con 0x7f8ae010c380 2026-02-13T03:45:25.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.104+0000 7f8ae48d66c0 1 -- 10.20.193.70:0/2274939754 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+22073 (secure 0 0 0) 0x7f8ac80071c0 con 0x7f8ae010c380 2026-02-13T03:45:25.107 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:25.107 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":69,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","created":"2026-02-13T03:42:55.979106+0000","modified":"2026-02-13T03:45:23.746377+0000","last_up_change":"2026-02-13T03:45:06.144024+0000","last_in_change":"2026-02-13T03:44:57.854565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:43:58.913146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:45:21.488475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:45:22.732576+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76aee801-8323-41e6-8540-7d0b5fa666e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6802","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6803","nonce":1468748446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6804","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6805","nonce":1468748446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6808","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6809","nonce":1468748446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6806","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6807","nonce":1468748446}]},"public_addr":"10.20.193.70:6803/1468748446","cluster_addr":"10.20.193.70:6805/1468748446","heartbeat_back_addr":"10.20.193.70:6809/1468748446","heartbeat_front_addr":"10.20.193.70:6807/1468748446","state":["exists","up"]},{"osd":1,"uuid":"621ea3ce-4cd8-4150-a1ba-f4e189f680bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6801","nonce":3454251527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6803","nonce":3454251527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6807","nonce":3454251527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6805","nonce":3454251527}]},"public_addr":"10.20.193.127:6801/3454251527","cluster_addr":"10.20.193.127:6803/3454251527","heartbeat_back_addr":"10.20.193.127:6807/3454251527","heartbeat_front_addr":"10.20.193.127:6805/3454251527","state":["exists","up"]},{"osd":2,"uuid":"17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6801","nonce":2599066943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6803","nonce":2599066943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6807","nonce":2599066943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6805","nonce":2599066943}]},"public_addr":"10.20.193.177:6801/2599066943","cluster_addr":"10.20.193.177:6803/2599066943","heartbeat_back_addr":"10.20.193.177:6807/2599066943","heartbeat_front_addr":"10.20.193.177:6805/2599066943","state":["exists","up"]},{"osd":3,"uuid":"31edcb70-f683-4525-b2c3-348788484124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6810","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6811","nonce":3715748086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6812","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6813","nonce":3715748086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6816","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6817","nonce":3715748086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6814","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6815","nonce":3715748086}]},"public_addr":"10.20.193.70:6811/3715748086","cluster_addr":"10.20.193.70:6813/3715748086","heartbeat_back_addr":"10.20.193.70:6817/3715748086","heartbeat_front_addr":"10.20.193.70:6815/3715748086","state":["exists","up"]},{"osd":4,"uuid":"82a40ce4-8f67-4a58-b08d-d7bfdbd447ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6809","nonce":2954348410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6811","nonce":2954348410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6815","nonce":2954348410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6813","nonce":2954348410}]},"public_addr":"10.20.193.127:6809/2954348410","cluster_addr":"10.20.193.127:6811/2954348410","heartbeat_back_addr":"10.20.193.127:6815/2954348410","heartbeat_front_addr":"10.20.193.127:6813/2954348410","state":["exists","up"]},{"osd":5,"uuid":"f96cee85-6197-423b-a006-6d2d85772d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6809","nonce":2878984246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6811","nonce":2878984246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6815","nonce":2878984246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6813","nonce":2878984246}]},"public_addr":"10.20.193.177:6809/2878984246","cluster_addr":"10.20.193.177:6811/2878984246","heartbeat_back_addr":"10.20.193.177:6815/2878984246","heartbeat_front_addr":"10.20.193.177:6813/2878984246","state":["exists","up"]},{"osd":6,"uuid":"8703f159-2f0c-4744-8797-960d48eedfc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6818","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6819","nonce":192941608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6820","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6821","nonce":192941608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6824","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6825","nonce":192941608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6822","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6823","nonce":192941608}]},"public_addr":"10.20.193.70:6819/192941608","cluster_addr":"10.20.193.70:6821/192941608","heartbeat_back_addr":"10.20.193.70:6825/192941608","heartbeat_front_addr":"10.20.193.70:6823/192941608","state":["exists","up"]},{"osd":7,"uuid":"7203c134-bbbb-4980-b512-a49cb17481d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6817","nonce":3503194265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6819","nonce":3503194265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6823","nonce":3503194265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6821","nonce":3503194265}]},"public_addr":"10.20.193.127:6817/3503194265","cluster_addr":"10.20.193.127:6819/3503194265","heartbeat_back_addr":"10.20.193.127:6823/3503194265","heartbeat_front_addr":"10.20.193.127:6821/3503194265","state":["exists","up"]},{"osd":8,"uuid":"1771e760-778b-4f83-a0c5-12eeee43c768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6817","nonce":2623744285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6819","nonce":2623744285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6823","nonce":2623744285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6821","nonce":2623744285}]},"public_addr":"10.20.193.177:6817/2623744285","cluster_addr":"10.20.193.177:6819/2623744285","heartbeat_back_addr":"10.20.193.177:6823/2623744285","heartbeat_front_addr":"10.20.193.177:6821/2623744285","state":["exists","up"]},{"osd":9,"uuid":"2ad7ff96-14be-4cb9-9b52-1a00e064de38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6826","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6827","nonce":1992888403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6828","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6829","nonce":1992888403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6832","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6833","nonce":1992888403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6830","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6831","nonce":1992888403}]},"public_addr":"10.20.193.70:6827/1992888403","cluster_addr":"10.20.193.70:6829/1992888403","heartbeat_back_addr":"10.20.193.70:6833/1992888403","heartbeat_front_addr":"10.20.193.70:6831/1992888403","state":["exists","up"]},{"osd":10,"uuid":"3ca6791a-ad2b-4701-a67d-17e83888b9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6825","nonce":380098770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6827","nonce":380098770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6831","nonce":380098770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6829","nonce":380098770}]},"public_addr":"10.20.193.127:6825/380098770","cluster_addr":"10.20.193.127:6827/380098770","heartbeat_back_addr":"10.20.193.127:6831/380098770","heartbeat_front_addr":"10.20.193.127:6829/380098770","state":["exists","up"]},{"osd":11,"uuid":"0d51bb23-8f23-43b5-b697-ca294fd39e89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6825","nonce":3785556542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6827","nonce":3785556542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6831","nonce":3785556542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6829","nonce":3785556542}]},"public_addr":"10.20.193.177:6825/3785556542","cluster_addr":"10.20.193.177:6827/3785556542","heartbeat_back_addr":"10.20.193.177:6831/3785556542","heartbeat_front_addr":"10.20.193.177:6829/3785556542","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:43.223664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:50.561682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:57.716321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:05.230108+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:12.548595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:19.918131+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:27.198884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:34.668843+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:42.036449+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:49.563635+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:57.025291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:45:04.376713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.70:6801/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:6800/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/1475427018":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/2220510112":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/3723878791":"2026-02-14T03:43:02.018661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:45:25.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8ab40b5600 msgr2=0x7f8ab40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:25.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8ab40b5600 0x7f8ab40d5ab0 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ad4006b60 tx=0x7f8ad4006af0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 msgr2=0x7f8ae0160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:25.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 0x7f8ae0160ab0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ac80092b0 tx=0x7f8ac802fd40 comp rx=0 tx=0).stop 2026-02-13T03:45:25.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 shutdown_connections 2026-02-13T03:45:25.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f8ab40b5600 0x7f8ab40d5ab0 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ae01557a0 0x7f8ae0165e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8ae010c380 0x7f8ae0160ab0 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 --2- 10.20.193.70:0/2274939754 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8ae010ba70 0x7f8ae0160570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 >> 10.20.193.70:0/2274939754 conn(0x7f8ae00e9770 msgr2=0x7f8ae0109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:25.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 shutdown_connections 2026-02-13T03:45:25.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.106+0000 7f8ae58dc6c0 1 -- 10.20.193.70:0/2274939754 wait complete. 2026-02-13T03:45:25.148 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-13T03:45:25.266 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:25.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.385+0000 7f4425c256c0 1 -- 10.20.193.70:0/3133821231 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f442010fbf0 msgr2=0x7f4420114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:25.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.385+0000 7f4425c256c0 1 --2- 10.20.193.70:0/3133821231 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f442010fbf0 0x7f4420114c30 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=11561368815506963893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44100099a0 tx=0x7f441002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:25.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.385+0000 7f4425c256c0 1 -- 10.20.193.70:0/3133821231 shutdown_connections 2026-02-13T03:45:25.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.385+0000 7f4425c256c0 1 --2- 10.20.193.70:0/3133821231 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4420115410 0x7f4420175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.385+0000 7f4425c256c0 1 --2- 10.20.193.70:0/3133821231 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f442010fbf0 0x7f4420114c30 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=11561368815506963893 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.385+0000 7f4425c256c0 1 --2- 10.20.193.70:0/3133821231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f442010f200 0x7f442010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.385+0000 7f4425c256c0 1 -- 10.20.193.70:0/3133821231 >> 10.20.193.70:0/3133821231 conn(0x7f44200ecb00 msgr2=0x7f442010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:25.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.385+0000 7f4425c256c0 1 -- 10.20.193.70:0/3133821231 shutdown_connections 2026-02-13T03:45:25.387 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.385+0000 7f4425c256c0 1 -- 10.20.193.70:0/3133821231 wait complete. 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 Processor -- start 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 -- start start 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f442010f200 0x7f44200f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4420115410 0x7f4420175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f44200f5270 0x7f44200fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44200f5960 con 0x7f44200f5270 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f44200faa80 con 0x7f4420115410 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f44200fac40 con 0x7f442010f200 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f44200f5270 0x7f44200fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f44200f5270 0x7f44200fa540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52148/0 (socket says 10.20.193.70:52148) 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441ffff6c0 1 -- 10.20.193.70:0/116184758 learned_addr learned my addr 10.20.193.70:0/116184758 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441effd6c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4420115410 0x7f4420175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441f7fe6c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f442010f200 0x7f44200f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441ffff6c0 1 -- 10.20.193.70:0/116184758 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f442010f200 msgr2=0x7f44200f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441ffff6c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f442010f200 0x7f44200f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441ffff6c0 1 -- 10.20.193.70:0/116184758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4420115410 msgr2=0x7f4420175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441ffff6c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4420115410 0x7f4420175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441ffff6c0 1 -- 10.20.193.70:0/116184758 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4410009590 con 0x7f44200f5270 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441effd6c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4420115410 0x7f4420175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441ffff6c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f44200f5270 0x7f44200fa540 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4414006a60 tx=0x7f441400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441cff96c0 1 -- 10.20.193.70:0/116184758 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4414003c40 con 0x7f44200f5270 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44200faf20 con 0x7f44200f5270 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441cff96c0 1 -- 10.20.193.70:0/116184758 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f441400a070 con 0x7f44200f5270 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44200fb6b0 con 0x7f44200f5270 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.386+0000 7f441cff96c0 1 -- 10.20.193.70:0/116184758 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f441400ddd0 con 0x7f44200f5270 2026-02-13T03:45:25.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.387+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44201104d0 con 0x7f44200f5270 2026-02-13T03:45:25.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.388+0000 7f441cff96c0 1 -- 10.20.193.70:0/116184758 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f4414005030 con 0x7f44200f5270 2026-02-13T03:45:25.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.389+0000 7f441cff96c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f43f40b5600 0x7f43f40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:25.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.389+0000 7f441f7fe6c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f43f40b5600 0x7f43f40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:25.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.389+0000 7f441cff96c0 1 -- 10.20.193.70:0/116184758 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f44140e48c0 con 0x7f44200f5270 2026-02-13T03:45:25.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.389+0000 7f441cff96c0 1 -- 10.20.193.70:0/116184758 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f44140a7480 con 0x7f44200f5270 2026-02-13T03:45:25.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.389+0000 7f441f7fe6c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f43f40b5600 0x7f43f40d5ab0 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f440c004750 tx=0x7f440c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:25.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:25.507+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f44200f5d90 con 0x7f44200f5270 2026-02-13T03:45:25.509 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:25 trial070 ceph-mon[24757]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T03:45:25.509 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:25 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2112883744' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T03:45:25.509 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:25 trial070 ceph-mon[24757]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T03:45:25.509 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:25 trial070 ceph-mon[24757]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T03:45:25.509 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:25 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1205790909' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:25.509 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:25 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2274939754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:25.509 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:25 trial070 ceph-mon[24757]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T03:45:25.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:25 trial177 ceph-mon[27082]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T03:45:25.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:25 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2112883744' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T03:45:25.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:25 trial177 ceph-mon[27082]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T03:45:25.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:25 trial177 ceph-mon[27082]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T03:45:25.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:25 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1205790909' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:25.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:25 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2274939754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:25.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:25 trial177 ceph-mon[27082]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T03:45:25.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:25 trial127 ceph-mon[26439]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T03:45:25.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:25 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2112883744' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T03:45:25.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:25 trial127 ceph-mon[26439]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T03:45:25.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:25 trial127 ceph-mon[26439]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T03:45:25.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:25 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1205790909' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:25.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:25 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2274939754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:25.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:25 trial127 ceph-mon[26439]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T03:45:26.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.357+0000 7f441cff96c0 1 -- 10.20.193.70:0/116184758 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f44140aa630 con 0x7f44200f5270 2026-02-13T03:45:26.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f43f40b5600 msgr2=0x7f43f40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:26.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f43f40b5600 0x7f43f40d5ab0 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f440c004750 tx=0x7f440c009260 comp rx=0 tx=0).stop 2026-02-13T03:45:26.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f44200f5270 msgr2=0x7f44200fa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:26.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f44200f5270 0x7f44200fa540 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4414006a60 tx=0x7f441400cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 shutdown_connections 2026-02-13T03:45:26.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f43f40b5600 0x7f43f40d5ab0 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.360 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f44200f5270 0x7f44200fa540 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.361 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4420115410 0x7f4420175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.361 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 --2- 10.20.193.70:0/116184758 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f442010f200 0x7f44200f4c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.361 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 >> 10.20.193.70:0/116184758 conn(0x7f44200ecb00 msgr2=0x7f4420111bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:26.361 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 shutdown_connections 2026-02-13T03:45:26.361 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.359+0000 7f4425c256c0 1 -- 10.20.193.70:0/116184758 wait complete. 2026-02-13T03:45:26.401 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2026-02-13T03:45:26.401 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-13T03:45:26.519 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:26.635 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:26 trial070 ceph-mon[24757]: mds.? [v2:10.20.193.127:6838/4111425300,v1:10.20.193.127:6839/4111425300] up:active 2026-02-13T03:45:26.635 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:26 trial070 ceph-mon[24757]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:45:26.635 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:26 trial070 ceph-mon[24757]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:45:26.635 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:26 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/116184758' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T03:45:26.635 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:26 trial070 ceph-mon[24757]: pgmap v187: 97 pgs: 16 creating+peering, 50 unknown, 31 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s wr, 0 op/s 2026-02-13T03:45:26.642 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.638+0000 7f78a4d146c0 1 -- 10.20.193.70:0/2888740881 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 msgr2=0x7f78a010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:26.642 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.638+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/2888740881 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 0x7f78a010f5d0 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=14883205227390781431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78940099a0 tx=0x7f789402ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:26.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.638+0000 7f78a4d146c0 1 -- 10.20.193.70:0/2888740881 shutdown_connections 2026-02-13T03:45:26.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.638+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/2888740881 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78a0115410 0x7f78a0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.638+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/2888740881 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78a010fbf0 0x7f78a0114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.638+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/2888740881 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 0x7f78a010f5d0 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=14883205227390781431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.638+0000 7f78a4d146c0 1 -- 10.20.193.70:0/2888740881 >> 10.20.193.70:0/2888740881 conn(0x7f78a00ecb00 msgr2=0x7f78a010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:26.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.638+0000 7f78a4d146c0 1 -- 10.20.193.70:0/2888740881 shutdown_connections 2026-02-13T03:45:26.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.638+0000 7f78a4d146c0 1 -- 10.20.193.70:0/2888740881 wait complete. 2026-02-13T03:45:26.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 Processor -- start 2026-02-13T03:45:26.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 -- start start 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 0x7f78a011d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78a0115410 0x7f78a011d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78a0122b60 0x7f78a0123000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0123570 con 0x7f78a010f200 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f78a01236e0 con 0x7f78a0122b60 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f78a01238a0 con 0x7f78a0115410 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789e5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 0x7f78a011d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789e5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 0x7f78a011d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33466/0 (socket says 10.20.193.70:33466) 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789e5756c0 1 -- 10.20.193.70:0/1671724360 learned_addr learned my addr 10.20.193.70:0/1671724360 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789ed766c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78a0122b60 0x7f78a0123000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:26.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789dd746c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78a0115410 0x7f78a011d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789e5756c0 1 -- 10.20.193.70:0/1671724360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78a0115410 msgr2=0x7f78a011d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789e5756c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78a0115410 0x7f78a011d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789e5756c0 1 -- 10.20.193.70:0/1671724360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78a0122b60 msgr2=0x7f78a0123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789e5756c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78a0122b60 0x7f78a0123000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789e5756c0 1 -- 10.20.193.70:0/1671724360 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7894009590 con 0x7f78a010f200 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789dd746c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78a0115410 0x7f78a011d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f789e5756c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 0x7f78a011d260 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f789402f230 tx=0x7f789402fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78877fe6c0 1 -- 10.20.193.70:0/1671724360 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7894002ae0 con 0x7f78a010f200 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a0163cf0 con 0x7f78a010f200 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78877fe6c0 1 -- 10.20.193.70:0/1671724360 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7894002c40 con 0x7f78a010f200 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78877fe6c0 1 -- 10.20.193.70:0/1671724360 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78940372f0 con 0x7f78a010f200 2026-02-13T03:45:26.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.639+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a0164120 con 0x7f78a010f200 2026-02-13T03:45:26.646 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.640+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a01104d0 con 0x7f78a010f200 2026-02-13T03:45:26.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.641+0000 7f78877fe6c0 1 -- 10.20.193.70:0/1671724360 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f7894007810 con 0x7f78a010f200 2026-02-13T03:45:26.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.642+0000 7f78877fe6c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78780b5600 0x7f78780d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:26.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.642+0000 7f789dd746c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78780b5600 0x7f78780d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:26.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.642+0000 7f78877fe6c0 1 -- 10.20.193.70:0/1671724360 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f7894107c00 con 0x7f78a010f200 2026-02-13T03:45:26.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.642+0000 7f78877fe6c0 1 -- 10.20.193.70:0/1671724360 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f78940cd970 con 0x7f78a010f200 2026-02-13T03:45:26.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.642+0000 7f789dd746c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78780b5600 0x7f78780d5ab0 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78a0123bf0 tx=0x7f7888009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:26.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:26 trial177 ceph-mon[27082]: mds.? [v2:10.20.193.127:6838/4111425300,v1:10.20.193.127:6839/4111425300] up:active 2026-02-13T03:45:26.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:26 trial177 ceph-mon[27082]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:45:26.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:26 trial177 ceph-mon[27082]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:45:26.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:26 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/116184758' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T03:45:26.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:26 trial177 ceph-mon[27082]: pgmap v187: 97 pgs: 16 creating+peering, 50 unknown, 31 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s wr, 0 op/s 2026-02-13T03:45:26.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:26 trial127 ceph-mon[26439]: mds.? [v2:10.20.193.127:6838/4111425300,v1:10.20.193.127:6839/4111425300] up:active 2026-02-13T03:45:26.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:26 trial127 ceph-mon[26439]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:45:26.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:26 trial127 ceph-mon[26439]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:45:26.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:26 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/116184758' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T03:45:26.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:26 trial127 ceph-mon[26439]: pgmap v187: 97 pgs: 16 creating+peering, 50 unknown, 31 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s wr, 0 op/s 2026-02-13T03:45:26.762 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.761+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f78a010f5d0 con 0x7f78a010f200 2026-02-13T03:45:26.908 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.907+0000 7f78877fe6c0 1 -- 10.20.193.70:0/1671724360 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f78940cdb50 con 0x7f78a010f200 2026-02-13T03:45:26.910 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78780b5600 msgr2=0x7f78780d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:26.910 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78780b5600 0x7f78780d5ab0 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78a0123bf0 tx=0x7f7888009260 comp rx=0 tx=0).stop 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 msgr2=0x7f78a011d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 0x7f78a011d260 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f789402f230 tx=0x7f789402fc00 comp rx=0 tx=0).stop 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 shutdown_connections 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78780b5600 0x7f78780d5ab0 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78a0122b60 0x7f78a0123000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78a0115410 0x7f78a011d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 --2- 10.20.193.70:0/1671724360 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78a010f200 0x7f78a011d260 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 >> 10.20.193.70:0/1671724360 conn(0x7f78a00ecb00 msgr2=0x7f78a010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 shutdown_connections 2026-02-13T03:45:26.911 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:26.908+0000 7f78a4d146c0 1 -- 10.20.193.70:0/1671724360 wait complete. 2026-02-13T03:45:26.953 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-13T03:45:27.070 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:27.190 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.185+0000 7f16488a06c0 1 -- 10.20.193.70:0/2444223519 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f164010fc20 msgr2=0x7f1640114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:27.190 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.185+0000 7f16488a06c0 1 --2- 10.20.193.70:0/2444223519 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f164010fc20 0x7f1640114c60 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=16175835101838564890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f162c0099a0 tx=0x7f162c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:27.190 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.185+0000 7f16488a06c0 1 -- 10.20.193.70:0/2444223519 shutdown_connections 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.185+0000 7f16488a06c0 1 --2- 10.20.193.70:0/2444223519 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1640115440 0x7f1640175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.185+0000 7f16488a06c0 1 --2- 10.20.193.70:0/2444223519 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f164010fc20 0x7f1640114c60 unknown :-1 s=CLOSED pgs=230 gs=1 cs=0 l=1 c_cookie=16175835101838564890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.185+0000 7f16488a06c0 1 --2- 10.20.193.70:0/2444223519 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f164010f230 0x7f164010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.185+0000 7f16488a06c0 1 -- 10.20.193.70:0/2444223519 >> 10.20.193.70:0/2444223519 conn(0x7f16400ecb30 msgr2=0x7f164010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.185+0000 7f16488a06c0 1 -- 10.20.193.70:0/2444223519 shutdown_connections 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.185+0000 7f16488a06c0 1 -- 10.20.193.70:0/2444223519 wait complete. 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 Processor -- start 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 -- start start 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164010f230 0x7f16400f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:27.191 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1640115440 0x7f1640175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16400f5300 0x7f16400fa5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f16400f59f0 con 0x7f1640115440 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f16400fab10 con 0x7f164010f230 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f16400facd0 con 0x7f16400f5300 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1645e146c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1640115440 0x7f1640175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1645e146c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1640115440 0x7f1640175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33484/0 (socket says 10.20.193.70:33484) 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1645e146c0 1 -- 10.20.193.70:0/3800930594 learned_addr learned my addr 10.20.193.70:0/3800930594 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16466156c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164010f230 0x7f16400f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1645e146c0 1 -- 10.20.193.70:0/3800930594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16400f5300 msgr2=0x7f16400fa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1646e166c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16400f5300 0x7f16400fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:27.192 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1645e146c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16400f5300 0x7f16400fa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1645e146c0 1 -- 10.20.193.70:0/3800930594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164010f230 msgr2=0x7f16400f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1645e146c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164010f230 0x7f16400f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1645e146c0 1 -- 10.20.193.70:0/3800930594 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162c009590 con 0x7f1640115440 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1646e166c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16400f5300 0x7f16400fa5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f1645e146c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1640115440 0x7f1640175ce0 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f162c0023c0 tx=0x7f162c02fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f162b7fe6c0 1 -- 10.20.193.70:0/3800930594 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f162c002ae0 con 0x7f1640115440 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f162b7fe6c0 1 -- 10.20.193.70:0/3800930594 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f162c002c40 con 0x7f1640115440 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16400faf50 con 0x7f1640115440 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f162b7fe6c0 1 -- 10.20.193.70:0/3800930594 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f162c0372f0 con 0x7f1640115440 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.186+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16400fb3d0 con 0x7f1640115440 2026-02-13T03:45:27.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.187+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1640110500 con 0x7f1640115440 2026-02-13T03:45:27.194 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.188+0000 7f162b7fe6c0 1 -- 10.20.193.70:0/3800930594 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f162c007810 con 0x7f1640115440 2026-02-13T03:45:27.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.189+0000 7f162b7fe6c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f161c0b5600 0x7f161c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:27.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.189+0000 7f16466156c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f161c0b5600 0x7f161c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:27.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.189+0000 7f162b7fe6c0 1 -- 10.20.193.70:0/3800930594 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f162c107ac0 con 0x7f1640115440 2026-02-13T03:45:27.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.189+0000 7f16466156c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f161c0b5600 0x7f161c0d5ab0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1638005980 tx=0x7f1638005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:27.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.189+0000 7f162b7fe6c0 1 -- 10.20.193.70:0/3800930594 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f162c0ca640 con 0x7f1640115440 2026-02-13T03:45:27.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.307+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f164010f600 con 0x7f1640115440 2026-02-13T03:45:27.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:27 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/116184758' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T03:45:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:27 trial070 ceph-mon[24757]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:45:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:27 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1671724360' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T03:45:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:27 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1671724360' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T03:45:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:27 trial070 ceph-mon[24757]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2026-02-13T03:45:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:27 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3800930594' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T03:45:27.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:27 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/116184758' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T03:45:27.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:27 trial177 ceph-mon[27082]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:45:27.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:27 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1671724360' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T03:45:27.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:27 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1671724360' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T03:45:27.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:27 trial177 ceph-mon[27082]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2026-02-13T03:45:27.702 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:27 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3800930594' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T03:45:27.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:27 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/116184758' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T03:45:27.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:27 trial127 ceph-mon[26439]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T03:45:27.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:27 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1671724360' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T03:45:27.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:27 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1671724360' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T03:45:27.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:27 trial127 ceph-mon[26439]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2026-02-13T03:45:27.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:27 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3800930594' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T03:45:27.910 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.908+0000 7f162b7fe6c0 1 -- 10.20.193.70:0/3800930594 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7f162c007e60 con 0x7f1640115440 2026-02-13T03:45:27.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f161c0b5600 msgr2=0x7f161c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:27.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f161c0b5600 0x7f161c0d5ab0 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1638005980 tx=0x7f1638005910 comp rx=0 tx=0).stop 2026-02-13T03:45:27.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1640115440 msgr2=0x7f1640175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:27.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1640115440 0x7f1640175ce0 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f162c0023c0 tx=0x7f162c02fbf0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 shutdown_connections 2026-02-13T03:45:27.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f161c0b5600 0x7f161c0d5ab0 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.917 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16400f5300 0x7f16400fa5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.917 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1640115440 0x7f1640175ce0 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.917 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 --2- 10.20.193.70:0/3800930594 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f164010f230 0x7f16400f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:27.917 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 >> 10.20.193.70:0/3800930594 conn(0x7f16400ecb30 msgr2=0x7f1640113da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:27.917 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 shutdown_connections 2026-02-13T03:45:27.917 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:27.914+0000 7f16488a06c0 1 -- 10.20.193.70:0/3800930594 wait complete. 2026-02-13T03:45:27.958 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2026-02-13T03:45:27.959 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-13T03:45:28.076 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:28.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.195+0000 7ff201e846c0 1 -- 10.20.193.70:0/1160040629 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc1198f0 msgr2=0x7ff1fc17a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.195+0000 7ff201e846c0 1 --2- 10.20.193.70:0/1160040629 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc1198f0 0x7ff1fc17a2c0 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=2301131312688292875 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f000aa40 tx=0x7ff1f002fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.195+0000 7ff201e846c0 1 -- 10.20.193.70:0/1160040629 shutdown_connections 2026-02-13T03:45:28.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.195+0000 7ff201e846c0 1 --2- 10.20.193.70:0/1160040629 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc1198f0 0x7ff1fc17a2c0 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=2301131312688292875 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.195+0000 7ff201e846c0 1 --2- 10.20.193.70:0/1160040629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1fc114190 0x7ff1fc119140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.195+0000 7ff201e846c0 1 --2- 10.20.193.70:0/1160040629 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1fc1137a0 0x7ff1fc113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.195+0000 7ff201e846c0 1 -- 10.20.193.70:0/1160040629 >> 10.20.193.70:0/1160040629 conn(0x7ff1fc060760 msgr2=0x7ff1fc060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.195+0000 7ff201e846c0 1 -- 10.20.193.70:0/1160040629 shutdown_connections 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.195+0000 7ff201e846c0 1 -- 10.20.193.70:0/1160040629 wait complete. 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 Processor -- start 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 -- start start 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1fc1137a0 0x7ff1fc121710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1fc1198f0 0x7ff1fc121c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc127010 0x7ff1fc1274b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc127a20 con 0x7ff1fc127010 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc127b90 con 0x7ff1fc1137a0 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc127d50 con 0x7ff1fc1198f0 2026-02-13T03:45:28.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1fbfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc127010 0x7ff1fc1274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1fbfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc127010 0x7ff1fc1274b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33502/0 (socket says 10.20.193.70:33502) 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1fbfff6c0 1 -- 10.20.193.70:0/3605240194 learned_addr learned my addr 10.20.193.70:0/3605240194 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1fbfff6c0 1 -- 10.20.193.70:0/3605240194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1fc1198f0 msgr2=0x7ff1fc121c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1fbfff6c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1fc1198f0 0x7ff1fc121c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1fbfff6c0 1 -- 10.20.193.70:0/3605240194 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1fc1137a0 msgr2=0x7ff1fc121710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1fbfff6c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1fc1137a0 0x7ff1fc121710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1fbfff6c0 1 -- 10.20.193.70:0/3605240194 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f000a660 con 0x7ff1fc127010 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1fbfff6c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc127010 0x7ff1fc1274b0 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f000a3e0 tx=0x7ff1f0005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1f8ff96c0 1 -- 10.20.193.70:0/3605240194 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1f0003a30 con 0x7ff1fc127010 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1fc1681a0 con 0x7ff1fc127010 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1f8ff96c0 1 -- 10.20.193.70:0/3605240194 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff1f0003b90 con 0x7ff1fc127010 2026-02-13T03:45:28.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff1f8ff96c0 1 -- 10.20.193.70:0/3605240194 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1f00382f0 con 0x7ff1fc127010 2026-02-13T03:45:28.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.196+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1fc1685d0 con 0x7ff1fc127010 2026-02-13T03:45:28.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.197+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1fc1149e0 con 0x7ff1fc127010 2026-02-13T03:45:28.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.198+0000 7ff1f8ff96c0 1 -- 10.20.193.70:0/3605240194 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7ff1f0008260 con 0x7ff1fc127010 2026-02-13T03:45:28.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.198+0000 7ff1f8ff96c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1d00b5600 0x7ff1d00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:28.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.198+0000 7ff1f8ff96c0 1 -- 10.20.193.70:0/3605240194 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7ff1f0108ed0 con 0x7ff1fc127010 2026-02-13T03:45:28.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.198+0000 7ff1fb7fe6c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1d00b5600 0x7ff1d00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:28.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.199+0000 7ff1fb7fe6c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1d00b5600 0x7ff1d00d5ab0 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1e8004750 tx=0x7ff1e80096a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:28.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.199+0000 7ff1f8ff96c0 1 -- 10.20.193.70:0/3605240194 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff1f00cba90 con 0x7ff1fc127010 2026-02-13T03:45:28.316 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.314+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff1fc114190 con 0x7ff1d00b5600 2026-02-13T03:45:28.331 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.330+0000 7ff1f8ff96c0 1 -- 10.20.193.70:0/3605240194 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff1fc114190 con 0x7ff1d00b5600 2026-02-13T03:45:28.333 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1d00b5600 msgr2=0x7ff1d00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.333 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1d00b5600 0x7ff1d00d5ab0 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1e8004750 tx=0x7ff1e80096a0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc127010 msgr2=0x7ff1fc1274b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc127010 0x7ff1fc1274b0 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f000a3e0 tx=0x7ff1f0005530 comp rx=0 tx=0).stop 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 shutdown_connections 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1d00b5600 0x7ff1d00d5ab0 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1fc127010 0x7ff1fc1274b0 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1fc1198f0 0x7ff1fc121c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 --2- 10.20.193.70:0/3605240194 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1fc1137a0 0x7ff1fc121710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 >> 10.20.193.70:0/3605240194 conn(0x7ff1fc060760 msgr2=0x7ff1fc116f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 shutdown_connections 2026-02-13T03:45:28.334 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.331+0000 7ff201e846c0 1 -- 10.20.193.70:0/3605240194 wait complete. 2026-02-13T03:45:28.373 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-13T03:45:28.490 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:28.512 INFO:journalctl@ceph.mgr.x.trial070.stdout:Feb 13 03:45:28 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-x[25009]: 2026-02-13T03:45:28.321+0000 7f9ec8cd96c0 -1 client.14868 error registering admin socket command: (17) File exists 2026-02-13T03:45:28.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.604+0000 7f24475f36c0 1 -- 10.20.193.70:0/4108378289 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010fc20 msgr2=0x7f2440114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.604+0000 7f24475f36c0 1 --2- 10.20.193.70:0/4108378289 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010fc20 0x7f2440114c60 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=6806764127200572376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24340099a0 tx=0x7f243402ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:28.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.604+0000 7f24475f36c0 1 -- 10.20.193.70:0/4108378289 shutdown_connections 2026-02-13T03:45:28.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.604+0000 7f24475f36c0 1 --2- 10.20.193.70:0/4108378289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2440115440 0x7f2440175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.604+0000 7f24475f36c0 1 --2- 10.20.193.70:0/4108378289 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010fc20 0x7f2440114c60 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=6806764127200572376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.604+0000 7f24475f36c0 1 --2- 10.20.193.70:0/4108378289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f244010f230 0x7f244010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.604+0000 7f24475f36c0 1 -- 10.20.193.70:0/4108378289 >> 10.20.193.70:0/4108378289 conn(0x7f24400ecb30 msgr2=0x7f244010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.604+0000 7f24475f36c0 1 -- 10.20.193.70:0/4108378289 shutdown_connections 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.604+0000 7f24475f36c0 1 -- 10.20.193.70:0/4108378289 wait complete. 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 Processor -- start 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 -- start start 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010f230 0x7f24400f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2440115440 0x7f2440175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24400f5300 0x7f24400fa5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24400f59f0 con 0x7f244010f230 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f24400fab10 con 0x7f24400f5300 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f24400facd0 con 0x7f2440115440 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24453646c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010f230 0x7f24400f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:28.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24453646c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010f230 0x7f24400f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33544/0 (socket says 10.20.193.70:33544) 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24453646c0 1 -- 10.20.193.70:0/3584663842 learned_addr learned my addr 10.20.193.70:0/3584663842 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f2444b636c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2440115440 0x7f2440175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f2445b656c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24400f5300 0x7f24400fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24453646c0 1 -- 10.20.193.70:0/3584663842 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2440115440 msgr2=0x7f2440175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24453646c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2440115440 0x7f2440175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24453646c0 1 -- 10.20.193.70:0/3584663842 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24400f5300 msgr2=0x7f24400fa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24453646c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24400f5300 0x7f24400fa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24453646c0 1 -- 10.20.193.70:0/3584663842 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2434009590 con 0x7f244010f230 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f2444b636c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2440115440 0x7f2440175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f2445b656c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24400f5300 0x7f24400fa5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24453646c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010f230 0x7f24400f4cd0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f243000b710 tx=0x7f243000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:28.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f242e7fc6c0 1 -- 10.20.193.70:0/3584663842 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2430004250 con 0x7f244010f230 2026-02-13T03:45:28.612 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24400fafb0 con 0x7f244010f230 2026-02-13T03:45:28.612 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f242e7fc6c0 1 -- 10.20.193.70:0/3584663842 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2430009070 con 0x7f244010f230 2026-02-13T03:45:28.612 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f242e7fc6c0 1 -- 10.20.193.70:0/3584663842 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f243000ccd0 con 0x7f244010f230 2026-02-13T03:45:28.612 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.605+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24400fb740 con 0x7f244010f230 2026-02-13T03:45:28.612 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.606+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2440110500 con 0x7f244010f230 2026-02-13T03:45:28.613 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.607+0000 7f242e7fc6c0 1 -- 10.20.193.70:0/3584663842 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f24300028c0 con 0x7f244010f230 2026-02-13T03:45:28.613 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.608+0000 7f242e7fc6c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f241c0b5600 0x7f241c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:28.613 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.608+0000 7f2444b636c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f241c0b5600 0x7f241c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:28.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.608+0000 7f242e7fc6c0 1 -- 10.20.193.70:0/3584663842 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f24300e3b10 con 0x7f244010f230 2026-02-13T03:45:28.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.608+0000 7f242e7fc6c0 1 -- 10.20.193.70:0/3584663842 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f24300a6690 con 0x7f244010f230 2026-02-13T03:45:28.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.608+0000 7f2444b636c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f241c0b5600 0x7f241c0d5ab0 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24340092e0 tx=0x7f2434005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:28.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.720+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f24400f5e20 con 0x7f241c0b5600 2026-02-13T03:45:28.737 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.735+0000 7f242e7fc6c0 1 -- 10.20.193.70:0/3584663842 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f24400f5e20 con 0x7f241c0b5600 2026-02-13T03:45:28.738 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f241c0b5600 msgr2=0x7f241c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.738 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f241c0b5600 0x7f241c0d5ab0 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24340092e0 tx=0x7f2434005c00 comp rx=0 tx=0).stop 2026-02-13T03:45:28.738 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010f230 msgr2=0x7f24400f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:28.738 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010f230 0x7f24400f4cd0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f243000b710 tx=0x7f243000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.739 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 shutdown_connections 2026-02-13T03:45:28.739 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f241c0b5600 0x7f241c0d5ab0 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.739 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f24400f5300 0x7f24400fa5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.739 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2440115440 0x7f2440175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.739 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 --2- 10.20.193.70:0/3584663842 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f244010f230 0x7f24400f4cd0 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:28.739 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 >> 10.20.193.70:0/3584663842 conn(0x7f24400ecb30 msgr2=0x7f2440113da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:28.739 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 shutdown_connections 2026-02-13T03:45:28.739 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:28.736+0000 7f24475f36c0 1 -- 10.20.193.70:0/3584663842 wait complete. 2026-02-13T03:45:28.781 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-13T03:45:28.912 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:29.029 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:28 trial070 ceph-mon[24757]: pgmap v188: 97 pgs: 16 creating+peering, 81 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.8 KiB/s wr, 2 op/s 2026-02-13T03:45:29.029 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:28 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3800930594' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T03:45:29.029 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:28 trial070 ceph-mon[24757]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2026-02-13T03:45:29.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/180734366 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810ba90 msgr2=0x7fbdf810be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/180734366 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810ba90 0x7fbdf810be60 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=2059936933910275683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbde8009970 tx=0x7fbde802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:29.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/180734366 shutdown_connections 2026-02-13T03:45:29.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/180734366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf81557c0 0x7fbdf8175ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/180734366 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbdf810c3a0 0x7fbdf8155280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/180734366 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810ba90 0x7fbdf810be60 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=2059936933910275683 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/180734366 >> 10.20.193.70:0/180734366 conn(0x7fbdf80e9770 msgr2=0x7fbdf8109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/180734366 shutdown_connections 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/180734366 wait complete. 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 Processor -- start 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 -- start start 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf810ba90 0x7fbdf8160620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810c3a0 0x7fbdf8160b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbdf81557c0 0x7fbdf8165f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf8166570 con 0x7fbdf810c3a0 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf81666e0 con 0x7fbdf81557c0 2026-02-13T03:45:29.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfec3c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf81668a0 con 0x7fbdf810ba90 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdeffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810c3a0 0x7fbdf8160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdeffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810c3a0 0x7fbdf8160b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33554/0 (socket says 10.20.193.70:33554) 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdeffff6c0 1 -- 10.20.193.70:0/2634133184 learned_addr learned my addr 10.20.193.70:0/2634133184 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfd1ae6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbdf81557c0 0x7fbdf8165f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.035+0000 7fbdfc9ad6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf810ba90 0x7fbdf8160620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdeffff6c0 1 -- 10.20.193.70:0/2634133184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf810ba90 msgr2=0x7fbdf8160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdeffff6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf810ba90 0x7fbdf8160620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdeffff6c0 1 -- 10.20.193.70:0/2634133184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbdf81557c0 msgr2=0x7fbdf8165f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdeffff6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbdf81557c0 0x7fbdf8165f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdeffff6c0 1 -- 10.20.193.70:0/2634133184 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde8009590 con 0x7fbdf810c3a0 2026-02-13T03:45:29.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdfd1ae6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbdf81557c0 0x7fbdf8165f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:29.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdeffff6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810c3a0 0x7fbdf8160b60 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbde000b710 tx=0x7fbde000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:29.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdedffb6c0 1 -- 10.20.193.70:0/2634133184 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbde0004250 con 0x7fbdf810c3a0 2026-02-13T03:45:29.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdedffb6c0 1 -- 10.20.193.70:0/2634133184 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbde0009070 con 0x7fbdf810c3a0 2026-02-13T03:45:29.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf8166b80 con 0x7fbdf810c3a0 2026-02-13T03:45:29.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdedffb6c0 1 -- 10.20.193.70:0/2634133184 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbde000ccd0 con 0x7fbdf810c3a0 2026-02-13T03:45:29.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf8152400 con 0x7fbdf810c3a0 2026-02-13T03:45:29.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.036+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf805fb30 con 0x7fbdf810c3a0 2026-02-13T03:45:29.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.037+0000 7fbdedffb6c0 1 -- 10.20.193.70:0/2634133184 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fbde00028c0 con 0x7fbdf810c3a0 2026-02-13T03:45:29.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.038+0000 7fbdedffb6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbdd40b5600 0x7fbdd40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.038+0000 7fbdedffb6c0 1 -- 10.20.193.70:0/2634133184 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fbde00e3b10 con 0x7fbdf810c3a0 2026-02-13T03:45:29.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.038+0000 7fbdfc9ad6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbdd40b5600 0x7fbdd40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.038+0000 7fbdfc9ad6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbdd40b5600 0x7fbdd40d5ab0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbde8005b40 tx=0x7fbde8005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:29.044 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.039+0000 7fbdedffb6c0 1 -- 10.20.193.70:0/2634133184 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbde00a6690 con 0x7fbdf810c3a0 2026-02-13T03:45:29.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.153+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fbdf8161800 con 0x7fbdd40b5600 2026-02-13T03:45:29.157 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.155+0000 7fbdedffb6c0 1 -- 10.20.193.70:0/2634133184 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fbde802f700 con 0x7fbdd40b5600 2026-02-13T03:45:29.158 INFO:teuthology.orchestra.run.trial070.stdout:/volumes/qa/sv_0/10041c79-d5f7-4f52-9903-c6feac6d9cba 2026-02-13T03:45:29.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbdd40b5600 msgr2=0x7fbdd40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbdd40b5600 0x7fbdd40d5ab0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbde8005b40 tx=0x7fbde8005c00 comp rx=0 tx=0).stop 2026-02-13T03:45:29.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810c3a0 msgr2=0x7fbdf8160b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810c3a0 0x7fbdf8160b60 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbde000b710 tx=0x7fbde000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 shutdown_connections 2026-02-13T03:45:29.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbdd40b5600 0x7fbdd40d5ab0 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbdf81557c0 0x7fbdf8165f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbdf810c3a0 0x7fbdf8160b60 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 --2- 10.20.193.70:0/2634133184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf810ba90 0x7fbdf8160620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 >> 10.20.193.70:0/2634133184 conn(0x7fbdf80e9770 msgr2=0x7fbdf8109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:29.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 shutdown_connections 2026-02-13T03:45:29.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.157+0000 7fbdfec3c6c0 1 -- 10.20.193.70:0/2634133184 wait complete. 2026-02-13T03:45:29.201 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-13T03:45:29.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:28 trial177 ceph-mon[27082]: pgmap v188: 97 pgs: 16 creating+peering, 81 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.8 KiB/s wr, 2 op/s 2026-02-13T03:45:29.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:28 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3800930594' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T03:45:29.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:28 trial177 ceph-mon[27082]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2026-02-13T03:45:29.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:28 trial127 ceph-mon[26439]: pgmap v188: 97 pgs: 16 creating+peering, 81 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.8 KiB/s wr, 2 op/s 2026-02-13T03:45:29.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:28 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3800930594' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T03:45:29.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:28 trial127 ceph-mon[26439]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2026-02-13T03:45:29.320 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 -- 10.20.193.70:0/2532740691 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 msgr2=0x7f2e08175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 --2- 10.20.193.70:0/2532740691 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 0x7f2e08175de0 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=13909007141043438526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e0400aa70 tx=0x7f2e0402fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 -- 10.20.193.70:0/2532740691 shutdown_connections 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 --2- 10.20.193.70:0/2532740691 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 0x7f2e08175de0 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=13909007141043438526 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 --2- 10.20.193.70:0/2532740691 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0810fc20 0x7f2e08114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 --2- 10.20.193.70:0/2532740691 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e0810f230 0x7f2e0810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 -- 10.20.193.70:0/2532740691 >> 10.20.193.70:0/2532740691 conn(0x7f2e080ecb30 msgr2=0x7f2e0810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 -- 10.20.193.70:0/2532740691 shutdown_connections 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 -- 10.20.193.70:0/2532740691 wait complete. 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 Processor -- start 2026-02-13T03:45:29.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 -- start start 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0810f230 0x7f2e0811d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 0x7f2e0811d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e08122b10 0x7f2e08122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2e08123520 con 0x7f2e08115440 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2e08123690 con 0x7f2e08122b10 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e104176c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e08123850 con 0x7f2e0810f230 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e0d9876c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 0x7f2e0811d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e0d9876c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 0x7f2e0811d750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33568/0 (socket says 10.20.193.70:33568) 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e0d9876c0 1 -- 10.20.193.70:0/1176536615 learned_addr learned my addr 10.20.193.70:0/1176536615 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e0e1886c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0810f230 0x7f2e0811d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.434+0000 7f2e0e9896c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e08122b10 0x7f2e08122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e0d9876c0 1 -- 10.20.193.70:0/1176536615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0810f230 msgr2=0x7f2e0811d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e0d9876c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0810f230 0x7f2e0811d210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e0d9876c0 1 -- 10.20.193.70:0/1176536615 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e08122b10 msgr2=0x7f2e08122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e0d9876c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e08122b10 0x7f2e08122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e0d9876c0 1 -- 10.20.193.70:0/1176536615 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0400a660 con 0x7f2e08115440 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e0e9896c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e08122b10 0x7f2e08122fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e0d9876c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 0x7f2e0811d750 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dfc00b750 tx=0x7f2dfc00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2def7fe6c0 1 -- 10.20.193.70:0/1176536615 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dfc004a80 con 0x7f2e08115440 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2def7fe6c0 1 -- 10.20.193.70:0/1176536615 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2dfc009030 con 0x7f2e08115440 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e08163d00 con 0x7f2e08115440 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2def7fe6c0 1 -- 10.20.193.70:0/1176536615 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dfc00cd00 con 0x7f2e08115440 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e08164190 con 0x7f2e08115440 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.435+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e08110500 con 0x7f2e08115440 2026-02-13T03:45:29.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.436+0000 7f2def7fe6c0 1 -- 10.20.193.70:0/1176536615 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f2dfc005020 con 0x7f2e08115440 2026-02-13T03:45:29.439 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.437+0000 7f2def7fe6c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2de40b5680 0x7f2de40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.439 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.437+0000 7f2e0e1886c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2de40b5680 0x7f2de40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.439 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.437+0000 7f2def7fe6c0 1 -- 10.20.193.70:0/1176536615 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f2dfc0e38f0 con 0x7f2e08115440 2026-02-13T03:45:29.439 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.437+0000 7f2e0e1886c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2de40b5680 0x7f2de40d5b30 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df8004750 tx=0x7f2df8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:29.439 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.438+0000 7f2def7fe6c0 1 -- 10.20.193.70:0/1176536615 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2dfc0a64b0 con 0x7f2e08115440 2026-02-13T03:45:29.551 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.549+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2e0811e3f0 con 0x7f2de40b5680 2026-02-13T03:45:29.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.561+0000 7f2def7fe6c0 1 -- 10.20.193.70:0/1176536615 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2df80099b0 con 0x7f2de40b5680 2026-02-13T03:45:29.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2de40b5680 msgr2=0x7f2de40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2de40b5680 0x7f2de40d5b30 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df8004750 tx=0x7f2df8009260 comp rx=0 tx=0).stop 2026-02-13T03:45:29.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 msgr2=0x7f2e0811d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 0x7f2e0811d750 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dfc00b750 tx=0x7f2dfc00bc20 comp rx=0 tx=0).stop 2026-02-13T03:45:29.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 shutdown_connections 2026-02-13T03:45:29.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2de40b5680 0x7f2de40d5b30 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e08122b10 0x7f2e08122fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e08115440 0x7f2e0811d750 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 --2- 10.20.193.70:0/1176536615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0810f230 0x7f2e0811d210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 >> 10.20.193.70:0/1176536615 conn(0x7f2e080ecb30 msgr2=0x7f2e0810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:29.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 shutdown_connections 2026-02-13T03:45:29.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.563+0000 7f2e104176c0 1 -- 10.20.193.70:0/1176536615 wait complete. 2026-02-13T03:45:29.606 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-13T03:45:29.723 INFO:journalctl@ceph.mds.b.trial127.stdout:Feb 13 03:45:29 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-b[55247]: 2026-02-13T03:45:29.335+0000 7f0c9bd006c0 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-13T03:45:29.724 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:29.841 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.837+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/2104968448 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 msgr2=0x7f4f0410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.837+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/2104968448 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 0x7f4f0410f600 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=7151308496453373419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ef40099a0 tx=0x7f4ef402ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.837+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/2104968448 shutdown_connections 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.837+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/2104968448 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f04115440 0x7f4f04175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.837+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/2104968448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f0410fc20 0x7f4f04114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.837+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/2104968448 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 0x7f4f0410f600 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=7151308496453373419 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.837+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/2104968448 >> 10.20.193.70:0/2104968448 conn(0x7f4f040ecb30 msgr2=0x7f4f0410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.837+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/2104968448 shutdown_connections 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.837+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/2104968448 wait complete. 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 Processor -- start 2026-02-13T03:45:29.842 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 -- start start 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 0x7f4f0411d300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f04115440 0x7f4f0411d840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f04122c00 0x7f4f041230a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f04123610 con 0x7f4f0410f230 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4f04123780 con 0x7f4f04115440 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4f04123940 con 0x7f4f04122c00 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f08bfd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 0x7f4f0411d300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f08bfd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 0x7f4f0411d300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33584/0 (socket says 10.20.193.70:33584) 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f08bfd6c0 1 -- 10.20.193.70:0/3828844247 learned_addr learned my addr 10.20.193.70:0/3828844247 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f093fe6c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f04122c00 0x7f4f041230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.843 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4efbfff6c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f04115440 0x7f4f0411d840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f08bfd6c0 1 -- 10.20.193.70:0/3828844247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f04122c00 msgr2=0x7f4f041230a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f08bfd6c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f04122c00 0x7f4f041230a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f08bfd6c0 1 -- 10.20.193.70:0/3828844247 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f04115440 msgr2=0x7f4f0411d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f08bfd6c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f04115440 0x7f4f0411d840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f08bfd6c0 1 -- 10.20.193.70:0/3828844247 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef4009590 con 0x7f4f0410f230 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f08bfd6c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 0x7f4f0411d300 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ef402f230 tx=0x7f4ef402fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4ef9ffb6c0 1 -- 10.20.193.70:0/3828844247 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ef4002ae0 con 0x7f4f0410f230 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f04163d90 con 0x7f4f0410f230 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4ef9ffb6c0 1 -- 10.20.193.70:0/3828844247 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4ef4002c40 con 0x7f4f0410f230 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4ef9ffb6c0 1 -- 10.20.193.70:0/3828844247 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ef40372f0 con 0x7f4f0410f230 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.838+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f04164210 con 0x7f4f0410f230 2026-02-13T03:45:29.844 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.839+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f04110500 con 0x7f4f0410f230 2026-02-13T03:45:29.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.840+0000 7f4ef9ffb6c0 1 -- 10.20.193.70:0/3828844247 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f4ef4007810 con 0x7f4f0410f230 2026-02-13T03:45:29.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.841+0000 7f4ef9ffb6c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4ee00b5680 0x7f4ee00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:29.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.841+0000 7f4efbfff6c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4ee00b5680 0x7f4ee00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:29.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.841+0000 7f4ef9ffb6c0 1 -- 10.20.193.70:0/3828844247 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f4ef4107b50 con 0x7f4f0410f230 2026-02-13T03:45:29.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.841+0000 7f4efbfff6c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4ee00b5680 0x7f4ee00d5b30 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f04123c90 tx=0x7f4eec009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:29.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.841+0000 7f4ef9ffb6c0 1 -- 10.20.193.70:0/3828844247 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4ef40ca6d0 con 0x7f4f0410f230 2026-02-13T03:45:29.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.959+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f4f0410fc20 con 0x7f4ee00b5680 2026-02-13T03:45:29.963 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.962+0000 7f4ef9ffb6c0 1 -- 10.20.193.70:0/3828844247 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4f0410fc20 con 0x7f4ee00b5680 2026-02-13T03:45:29.964 INFO:teuthology.orchestra.run.trial070.stdout:/volumes/qa/sv_1/151b4e0f-6310-41f8-b25d-0a63a261c694 2026-02-13T03:45:29.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4ee00b5680 msgr2=0x7f4ee00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4ee00b5680 0x7f4ee00d5b30 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f04123c90 tx=0x7f4eec009260 comp rx=0 tx=0).stop 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 msgr2=0x7f4f0411d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 0x7f4f0411d300 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ef402f230 tx=0x7f4ef402fc00 comp rx=0 tx=0).stop 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 shutdown_connections 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4ee00b5680 0x7f4ee00d5b30 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f04122c00 0x7f4f041230a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4f04115440 0x7f4f0411d840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 --2- 10.20.193.70:0/3828844247 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4f0410f230 0x7f4f0411d300 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 >> 10.20.193.70:0/3828844247 conn(0x7f4f040ecb30 msgr2=0x7f4f0410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 shutdown_connections 2026-02-13T03:45:29.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:29.964+0000 7f4f0ae886c0 1 -- 10.20.193.70:0/3828844247 wait complete. 2026-02-13T03:45:30.009 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T03:45:30.126 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:30.175 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:29 trial070 ceph-mon[24757]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:30.175 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:29 trial070 ceph-mon[24757]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:30.175 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:29 trial070 ceph-mon[24757]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:30.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:29 trial177 ceph-mon[27082]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:30.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:29 trial177 ceph-mon[27082]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:30.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:29 trial177 ceph-mon[27082]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:30.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:29 trial127 ceph-mon[26439]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:30.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:29 trial127 ceph-mon[26439]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:30.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:29 trial127 ceph-mon[26439]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:30.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 -- 10.20.193.70:0/896017833 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe22010f200 msgr2=0x7fe22010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 --2- 10.20.193.70:0/896017833 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe22010f200 0x7fe22010f5d0 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=5805240040339822738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2100099a0 tx=0x7fe21002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:30.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 -- 10.20.193.70:0/896017833 shutdown_connections 2026-02-13T03:45:30.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 --2- 10.20.193.70:0/896017833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe220115410 0x7fe220175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 --2- 10.20.193.70:0/896017833 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe22010fbf0 0x7fe220114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 --2- 10.20.193.70:0/896017833 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe22010f200 0x7fe22010f5d0 unknown :-1 s=CLOSED pgs=244 gs=1 cs=0 l=1 c_cookie=5805240040339822738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 -- 10.20.193.70:0/896017833 >> 10.20.193.70:0/896017833 conn(0x7fe2200ecb00 msgr2=0x7fe22010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 -- 10.20.193.70:0/896017833 shutdown_connections 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 -- 10.20.193.70:0/896017833 wait complete. 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 Processor -- start 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.246+0000 7fe227c946c0 1 -- start start 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe227c946c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe22010f200 0x7fe22011d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe227c946c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe220115410 0x7fe22011d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe227c946c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe220122bf0 0x7fe220123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe227c946c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe220123600 con 0x7fe220122bf0 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe227c946c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe220123770 con 0x7fe220115410 2026-02-13T03:45:30.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe227c946c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe220123930 con 0x7fe22010f200 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2262066c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe220122bf0 0x7fe220123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2262066c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe220122bf0 0x7fe220123090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33604/0 (socket says 10.20.193.70:33604) 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2262066c0 1 -- 10.20.193.70:0/1756611494 learned_addr learned my addr 10.20.193.70:0/1756611494 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2252046c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe220115410 0x7fe22011d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe225a056c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe22010f200 0x7fe22011d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2262066c0 1 -- 10.20.193.70:0/1756611494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe22010f200 msgr2=0x7fe22011d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2262066c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe22010f200 0x7fe22011d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2262066c0 1 -- 10.20.193.70:0/1756611494 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe220115410 msgr2=0x7fe22011d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2262066c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe220115410 0x7fe22011d830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2262066c0 1 -- 10.20.193.70:0/1756611494 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe210009590 con 0x7fe220122bf0 2026-02-13T03:45:30.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe225a056c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe22010f200 0x7fe22011d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:30.253 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2252046c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe220115410 0x7fe22011d830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:30.253 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe2262066c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe220122bf0 0x7fe220123090 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe21c006ea0 tx=0x7fe21c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:30.253 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe20effd6c0 1 -- 10.20.193.70:0/1756611494 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe21c003a30 con 0x7fe220122bf0 2026-02-13T03:45:30.253 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe20effd6c0 1 -- 10.20.193.70:0/1756611494 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe21c0054f0 con 0x7fe220122bf0 2026-02-13T03:45:30.253 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe220163de0 con 0x7fe220122bf0 2026-02-13T03:45:30.253 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe20effd6c0 1 -- 10.20.193.70:0/1756611494 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe21c00dcd0 con 0x7fe220122bf0 2026-02-13T03:45:30.253 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2201642c0 con 0x7fe220122bf0 2026-02-13T03:45:30.253 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.247+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2201104d0 con 0x7fe220122bf0 2026-02-13T03:45:30.254 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.249+0000 7fe20effd6c0 1 -- 10.20.193.70:0/1756611494 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7fe21c005030 con 0x7fe220122bf0 2026-02-13T03:45:30.254 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.250+0000 7fe20effd6c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1fc0b5680 0x7fe1fc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:30.255 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.250+0000 7fe20effd6c0 1 -- 10.20.193.70:0/1756611494 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fe21c0e4a90 con 0x7fe220122bf0 2026-02-13T03:45:30.255 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.250+0000 7fe225a056c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1fc0b5680 0x7fe1fc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:30.255 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.250+0000 7fe20effd6c0 1 -- 10.20.193.70:0/1756611494 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe21c0a7610 con 0x7fe220122bf0 2026-02-13T03:45:30.255 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.250+0000 7fe225a056c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1fc0b5680 0x7fe1fc0d5b30 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe210005b40 tx=0x7fe210005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:30.369 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.367+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe22010f5d0 con 0x7fe220122bf0 2026-02-13T03:45:30.369 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.367+0000 7fe20effd6c0 1 -- 10.20.193.70:0/1756611494 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+11885 (secure 0 0 0) 0x7fe21c0ab070 con 0x7fe220122bf0 2026-02-13T03:45:30.370 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:30.370 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":18,"btime":"2026-02-13T03:45:27:908397+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14724,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6835/4222419180","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6834","nonce":4222419180},{"type":"v1","addr":"10.20.193.70:6835","nonce":4222419180}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14736,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6837/4178814163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6836","nonce":4178814163},{"type":"v1","addr":"10.20.193.70:6837","nonce":4178814163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6839/1271943071","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6838","nonce":1271943071},{"type":"v1","addr":"10.20.193.70:6839","nonce":1271943071}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.70:6841/3526910033","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6840","nonce":3526910033},{"type":"v1","addr":"10.20.193.70:6841","nonce":3526910033}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6833/2607551184","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6832","nonce":2607551184},{"type":"v1","addr":"10.20.193.127:6833","nonce":2607551184}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/787205513","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":787205513},{"type":"v1","addr":"10.20.193.177:6833","nonce":787205513}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6835/721965507","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6834","nonce":721965507},{"type":"v1","addr":"10.20.193.127:6835","nonce":721965507}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6835/1936668239","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":1936668239},{"type":"v1","addr":"10.20.193.177:6835","nonce":1936668239}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6837/2542438956","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":2542438956},{"type":"v1","addr":"10.20.193.177:6837","nonce":2542438956}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.127:6837/4252675734","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6836","nonce":4252675734},{"type":"v1","addr":"10.20.193.127:6837","nonce":4252675734}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-13T03:45:23.746340+0000","modified":"2026-02-13T03:45:27.308915+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6839/145347701","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":145347701},{"type":"v1","addr":"10.20.193.177:6839","nonce":145347701}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"10.20.193.127:6839/4111425300","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6838","nonce":4111425300},{"type":"v1","addr":"10.20.193.127:6839","nonce":4111425300}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24494,"qdb_cluster":[24494]},"id":1}]} 2026-02-13T03:45:30.371 INFO:teuthology.orchestra.run.trial070.stderr:dumped fsmap epoch 18 2026-02-13T03:45:30.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1fc0b5680 msgr2=0x7fe1fc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1fc0b5680 0x7fe1fc0d5b30 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe210005b40 tx=0x7fe210005c00 comp rx=0 tx=0).stop 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe220122bf0 msgr2=0x7fe220123090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe220122bf0 0x7fe220123090 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe21c006ea0 tx=0x7fe21c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 shutdown_connections 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1fc0b5680 0x7fe1fc0d5b30 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe220122bf0 0x7fe220123090 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe220115410 0x7fe22011d830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 --2- 10.20.193.70:0/1756611494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe22010f200 0x7fe22011d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 >> 10.20.193.70:0/1756611494 conn(0x7fe2200ecb00 msgr2=0x7fe22010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 shutdown_connections 2026-02-13T03:45:30.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.368+0000 7fe227c946c0 1 -- 10.20.193.70:0/1756611494 wait complete. 2026-02-13T03:45:30.412 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:45:30.529 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:30.648 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 -- 10.20.193.70:0/94752188 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e410fc20 msgr2=0x7f75e4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/94752188 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e410fc20 0x7f75e4114c60 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=6213813791325583842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75d80099a0 tx=0x7f75d802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 -- 10.20.193.70:0/94752188 shutdown_connections 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/94752188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75e4115440 0x7f75e4175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/94752188 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e410fc20 0x7f75e4114c60 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=6213813791325583842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/94752188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f75e410f230 0x7f75e410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 -- 10.20.193.70:0/94752188 >> 10.20.193.70:0/94752188 conn(0x7f75e40ecb30 msgr2=0x7f75e410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 -- 10.20.193.70:0/94752188 shutdown_connections 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 -- 10.20.193.70:0/94752188 wait complete. 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.644+0000 7f75ec3646c0 1 Processor -- start 2026-02-13T03:45:30.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ec3646c0 1 -- start start 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ec3646c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75e410f230 0x7f75e40f4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ec3646c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f75e4115440 0x7f75e4175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ec3646c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e40f5330 0x7f75e40fa5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ec3646c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f75e40f5a20 con 0x7f75e40f5330 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ec3646c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f75e40faaf0 con 0x7f75e4115440 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ec3646c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f75e40facb0 con 0x7f75e410f230 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea8d66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e40f5330 0x7f75e40fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea8d66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e40f5330 0x7f75e40fa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33610/0 (socket says 10.20.193.70:33610) 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea8d66c0 1 -- 10.20.193.70:0/3789015327 learned_addr learned my addr 10.20.193.70:0/3789015327 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea0d56c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75e410f230 0x7f75e40f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75e98d46c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f75e4115440 0x7f75e4175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:30.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea8d66c0 1 -- 10.20.193.70:0/3789015327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75e410f230 msgr2=0x7f75e40f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea8d66c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75e410f230 0x7f75e40f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea8d66c0 1 -- 10.20.193.70:0/3789015327 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f75e4115440 msgr2=0x7f75e4175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea8d66c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f75e4115440 0x7f75e4175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea8d66c0 1 -- 10.20.193.70:0/3789015327 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d8009590 con 0x7f75e40f5330 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ea8d66c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e40f5330 0x7f75e40fa5b0 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75e0006ea0 tx=0x7f75e000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75cb7fe6c0 1 -- 10.20.193.70:0/3789015327 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f75e0003a30 con 0x7f75e40f5330 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75cb7fe6c0 1 -- 10.20.193.70:0/3789015327 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f75e00054f0 con 0x7f75e40f5330 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e40faf90 con 0x7f75e40f5330 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75cb7fe6c0 1 -- 10.20.193.70:0/3789015327 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f75e000dcd0 con 0x7f75e40f5330 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.645+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e40fb720 con 0x7f75e40f5330 2026-02-13T03:45:30.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.646+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e4110500 con 0x7f75e40f5330 2026-02-13T03:45:30.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.647+0000 7f75cb7fe6c0 1 -- 10.20.193.70:0/3789015327 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 11) ==== 157066+0+0 (secure 0 0 0) 0x7f75e0003b90 con 0x7f75e40f5330 2026-02-13T03:45:30.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.648+0000 7f75cb7fe6c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f75c00b5680 0x7f75c00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:30.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.648+0000 7f75cb7fe6c0 1 -- 10.20.193.70:0/3789015327 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f75e00e48a0 con 0x7f75e40f5330 2026-02-13T03:45:30.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.648+0000 7f75ea0d56c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f75c00b5680 0x7f75c00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:30.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.648+0000 7f75cb7fe6c0 1 -- 10.20.193.70:0/3789015327 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f75e00aa430 con 0x7f75e40f5330 2026-02-13T03:45:30.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.648+0000 7f75ea0d56c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f75c00b5680 0x7f75c00d5b30 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75d4004750 tx=0x7f75d4009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:30.742 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.740+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75e40f5e00 con 0x7f75e40f5330 2026-02-13T03:45:30.743 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.741+0000 7f75cb7fe6c0 1 -- 10.20.193.70:0/3789015327 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+22060 (secure 0 0 0) 0x7f75e00aa610 con 0x7f75e40f5330 2026-02-13T03:45:30.744 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:30.744 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":70,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","created":"2026-02-13T03:42:55.979106+0000","modified":"2026-02-13T03:45:25.344859+0000","last_up_change":"2026-02-13T03:45:06.144024+0000","last_in_change":"2026-02-13T03:44:57.854565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:43:58.913146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:45:21.488475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:45:22.732576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76aee801-8323-41e6-8540-7d0b5fa666e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6802","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6803","nonce":1468748446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6804","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6805","nonce":1468748446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6808","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6809","nonce":1468748446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6806","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6807","nonce":1468748446}]},"public_addr":"10.20.193.70:6803/1468748446","cluster_addr":"10.20.193.70:6805/1468748446","heartbeat_back_addr":"10.20.193.70:6809/1468748446","heartbeat_front_addr":"10.20.193.70:6807/1468748446","state":["exists","up"]},{"osd":1,"uuid":"621ea3ce-4cd8-4150-a1ba-f4e189f680bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6801","nonce":3454251527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6803","nonce":3454251527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6807","nonce":3454251527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6805","nonce":3454251527}]},"public_addr":"10.20.193.127:6801/3454251527","cluster_addr":"10.20.193.127:6803/3454251527","heartbeat_back_addr":"10.20.193.127:6807/3454251527","heartbeat_front_addr":"10.20.193.127:6805/3454251527","state":["exists","up"]},{"osd":2,"uuid":"17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6801","nonce":2599066943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6803","nonce":2599066943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6807","nonce":2599066943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6805","nonce":2599066943}]},"public_addr":"10.20.193.177:6801/2599066943","cluster_addr":"10.20.193.177:6803/2599066943","heartbeat_back_addr":"10.20.193.177:6807/2599066943","heartbeat_front_addr":"10.20.193.177:6805/2599066943","state":["exists","up"]},{"osd":3,"uuid":"31edcb70-f683-4525-b2c3-348788484124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6810","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6811","nonce":3715748086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6812","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6813","nonce":3715748086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6816","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6817","nonce":3715748086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6814","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6815","nonce":3715748086}]},"public_addr":"10.20.193.70:6811/3715748086","cluster_addr":"10.20.193.70:6813/3715748086","heartbeat_back_addr":"10.20.193.70:6817/3715748086","heartbeat_front_addr":"10.20.193.70:6815/3715748086","state":["exists","up"]},{"osd":4,"uuid":"82a40ce4-8f67-4a58-b08d-d7bfdbd447ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6809","nonce":2954348410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6811","nonce":2954348410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6815","nonce":2954348410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6813","nonce":2954348410}]},"public_addr":"10.20.193.127:6809/2954348410","cluster_addr":"10.20.193.127:6811/2954348410","heartbeat_back_addr":"10.20.193.127:6815/2954348410","heartbeat_front_addr":"10.20.193.127:6813/2954348410","state":["exists","up"]},{"osd":5,"uuid":"f96cee85-6197-423b-a006-6d2d85772d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6809","nonce":2878984246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6811","nonce":2878984246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6815","nonce":2878984246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6813","nonce":2878984246}]},"public_addr":"10.20.193.177:6809/2878984246","cluster_addr":"10.20.193.177:6811/2878984246","heartbeat_back_addr":"10.20.193.177:6815/2878984246","heartbeat_front_addr":"10.20.193.177:6813/2878984246","state":["exists","up"]},{"osd":6,"uuid":"8703f159-2f0c-4744-8797-960d48eedfc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6818","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6819","nonce":192941608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6820","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6821","nonce":192941608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6824","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6825","nonce":192941608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6822","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6823","nonce":192941608}]},"public_addr":"10.20.193.70:6819/192941608","cluster_addr":"10.20.193.70:6821/192941608","heartbeat_back_addr":"10.20.193.70:6825/192941608","heartbeat_front_addr":"10.20.193.70:6823/192941608","state":["exists","up"]},{"osd":7,"uuid":"7203c134-bbbb-4980-b512-a49cb17481d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6817","nonce":3503194265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6819","nonce":3503194265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6823","nonce":3503194265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6821","nonce":3503194265}]},"public_addr":"10.20.193.127:6817/3503194265","cluster_addr":"10.20.193.127:6819/3503194265","heartbeat_back_addr":"10.20.193.127:6823/3503194265","heartbeat_front_addr":"10.20.193.127:6821/3503194265","state":["exists","up"]},{"osd":8,"uuid":"1771e760-778b-4f83-a0c5-12eeee43c768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6817","nonce":2623744285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6819","nonce":2623744285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6823","nonce":2623744285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6821","nonce":2623744285}]},"public_addr":"10.20.193.177:6817/2623744285","cluster_addr":"10.20.193.177:6819/2623744285","heartbeat_back_addr":"10.20.193.177:6823/2623744285","heartbeat_front_addr":"10.20.193.177:6821/2623744285","state":["exists","up"]},{"osd":9,"uuid":"2ad7ff96-14be-4cb9-9b52-1a00e064de38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6826","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6827","nonce":1992888403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6828","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6829","nonce":1992888403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6832","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6833","nonce":1992888403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6830","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6831","nonce":1992888403}]},"public_addr":"10.20.193.70:6827/1992888403","cluster_addr":"10.20.193.70:6829/1992888403","heartbeat_back_addr":"10.20.193.70:6833/1992888403","heartbeat_front_addr":"10.20.193.70:6831/1992888403","state":["exists","up"]},{"osd":10,"uuid":"3ca6791a-ad2b-4701-a67d-17e83888b9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6825","nonce":380098770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6827","nonce":380098770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6831","nonce":380098770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6829","nonce":380098770}]},"public_addr":"10.20.193.127:6825/380098770","cluster_addr":"10.20.193.127:6827/380098770","heartbeat_back_addr":"10.20.193.127:6831/380098770","heartbeat_front_addr":"10.20.193.127:6829/380098770","state":["exists","up"]},{"osd":11,"uuid":"0d51bb23-8f23-43b5-b697-ca294fd39e89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6825","nonce":3785556542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6827","nonce":3785556542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6831","nonce":3785556542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6829","nonce":3785556542}]},"public_addr":"10.20.193.177:6825/3785556542","cluster_addr":"10.20.193.177:6827/3785556542","heartbeat_back_addr":"10.20.193.177:6831/3785556542","heartbeat_front_addr":"10.20.193.177:6829/3785556542","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:43.223664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:50.561682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:57.716321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:05.230108+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:12.548595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:19.918131+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:27.198884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:34.668843+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:42.036449+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:49.563635+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:57.025291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:45:04.376713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.70:6801/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:6800/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/1475427018":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/2220510112":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/3723878791":"2026-02-14T03:43:02.018661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:45:30.745 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f75c00b5680 msgr2=0x7f75c00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.745 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f75c00b5680 0x7f75c00d5b30 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75d4004750 tx=0x7f75d4009390 comp rx=0 tx=0).stop 2026-02-13T03:45:30.745 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e40f5330 msgr2=0x7f75e40fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:30.745 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e40f5330 0x7f75e40fa5b0 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75e0006ea0 tx=0x7f75e000cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.745 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 shutdown_connections 2026-02-13T03:45:30.745 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f75c00b5680 0x7f75c00d5b30 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.745 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f75e40f5330 0x7f75e40fa5b0 unknown :-1 s=CLOSED pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.746 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f75e4115440 0x7f75e4175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.746 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 --2- 10.20.193.70:0/3789015327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75e410f230 0x7f75e40f4d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:30.746 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 >> 10.20.193.70:0/3789015327 conn(0x7f75e40ecb30 msgr2=0x7f75e410d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:30.746 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 shutdown_connections 2026-02-13T03:45:30.746 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:30.742+0000 7f75ec3646c0 1 -- 10.20.193.70:0/3789015327 wait complete. 2026-02-13T03:45:30.784 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T03:45:30.784 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T03:45:30.902 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:31.017 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:30 trial070 ceph-mon[24757]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:31.017 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:30 trial070 ceph-mon[24757]: pgmap v189: 97 pgs: 97 active+clean; 586 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2026-02-13T03:45:31.017 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:30 trial070 ceph-mon[24757]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:31.018 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:30 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1756611494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:31.018 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:30 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3789015327' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:31.025 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.020+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/1302374113 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe90010fc20 msgr2=0x7fe900114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.025 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.020+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/1302374113 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe90010fc20 0x7fe900114c60 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=13997641472710650926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8e80099a0 tx=0x7fe8e802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:31.025 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/1302374113 shutdown_connections 2026-02-13T03:45:31.025 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/1302374113 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe900115440 0x7fe900175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.025 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/1302374113 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe90010fc20 0x7fe900114c60 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=13997641472710650926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.025 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/1302374113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe90010f230 0x7fe90010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.025 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/1302374113 >> 10.20.193.70:0/1302374113 conn(0x7fe9000ecb30 msgr2=0x7fe90010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:31.025 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/1302374113 shutdown_connections 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/1302374113 wait complete. 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 Processor -- start 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 -- start start 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe90010f230 0x7fe9000f4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe900115440 0x7fe900175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe9000f5330 0x7fe9000fa5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe9000f5a20 con 0x7fe9000f5330 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe9000faaf0 con 0x7fe90010f230 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe9000facb0 con 0x7fe900115440 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fed766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe9000f5330 0x7fe9000fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.026 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fed766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe9000f5330 0x7fe9000fa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33624/0 (socket says 10.20.193.70:33624) 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fed766c0 1 -- 10.20.193.70:0/3921519296 learned_addr learned my addr 10.20.193.70:0/3921519296 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fdd746c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe900115440 0x7fe900175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fe5756c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe90010f230 0x7fe9000f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fed766c0 1 -- 10.20.193.70:0/3921519296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe900115440 msgr2=0x7fe900175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fed766c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe900115440 0x7fe900175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fed766c0 1 -- 10.20.193.70:0/3921519296 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe90010f230 msgr2=0x7fe9000f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fed766c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe90010f230 0x7fe9000f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fed766c0 1 -- 10.20.193.70:0/3921519296 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e8009590 con 0x7fe9000f5330 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8fed766c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe9000f5330 0x7fe9000fa5b0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8f0006ea0 tx=0x7fe8f000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8e77fe6c0 1 -- 10.20.193.70:0/3921519296 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8f0003a30 con 0x7fe9000f5330 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe8e77fe6c0 1 -- 10.20.193.70:0/3921519296 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe8f00054f0 con 0x7fe9000f5330 2026-02-13T03:45:31.027 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.021+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9000faf90 con 0x7fe9000f5330 2026-02-13T03:45:31.028 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.022+0000 7fe8e77fe6c0 1 -- 10.20.193.70:0/3921519296 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8f000dcd0 con 0x7fe9000f5330 2026-02-13T03:45:31.028 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.022+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9000fb720 con 0x7fe9000f5330 2026-02-13T03:45:31.028 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.022+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe900110500 con 0x7fe9000f5330 2026-02-13T03:45:31.028 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.023+0000 7fe8e77fe6c0 1 -- 10.20.193.70:0/3921519296 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fe8f0003b90 con 0x7fe9000f5330 2026-02-13T03:45:31.029 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.024+0000 7fe8e77fe6c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8d80b5710 0x7fe8d80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.029 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.024+0000 7fe8fe5756c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8d80b5710 0x7fe8d80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.029 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.024+0000 7fe8e77fe6c0 1 -- 10.20.193.70:0/3921519296 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fe8f00e4b10 con 0x7fe9000f5330 2026-02-13T03:45:31.029 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.024+0000 7fe8fe5756c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8d80b5710 0x7fe8d80d5bc0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8f4005980 tx=0x7fe8f4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:31.029 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.024+0000 7fe8e77fe6c0 1 -- 10.20.193.70:0/3921519296 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe8f00a7530 con 0x7fe9000f5330 2026-02-13T03:45:31.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.115+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9000f5e00 con 0x7fe8d80b5710 2026-02-13T03:45:31.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.118+0000 7fe8e77fe6c0 1 -- 10.20.193.70:0/3921519296 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258847 (secure 0 0 0) 0x7fe9000f5e00 con 0x7fe8d80b5710 2026-02-13T03:45:31.123 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:31.124 INFO:teuthology.orchestra.run.trial070.stderr:dumped all 2026-02-13T03:45:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8d80b5710 msgr2=0x7fe8d80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8d80b5710 0x7fe8d80d5bc0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8f4005980 tx=0x7fe8f4005910 comp rx=0 tx=0).stop 2026-02-13T03:45:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe9000f5330 msgr2=0x7fe9000fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe9000f5330 0x7fe9000fa5b0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8f0006ea0 tx=0x7fe8f000cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 shutdown_connections 2026-02-13T03:45:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8d80b5710 0x7fe8d80d5bc0 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe9000f5330 0x7fe9000fa5b0 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe900115440 0x7fe900175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 --2- 10.20.193.70:0/3921519296 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe90010f230 0x7fe9000f4d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 >> 10.20.193.70:0/3921519296 conn(0x7fe9000ecb30 msgr2=0x7fe90010d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:31.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 shutdown_connections 2026-02-13T03:45:31.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.120+0000 7fe904aaf6c0 1 -- 10.20.193.70:0/3921519296 wait complete. 2026-02-13T03:45:31.161 INFO:teuthology.orchestra.run.trial070.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2026-02-13T03:45:29.781133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599573,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":99,"num_write":236,"num_write_kb":3739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":225,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":332684,"kb_used_data":9116,"kb_used_omap":302,"kb_used_meta":323025,"kb_avail":8807705716,"statfs":{"total":9019431321600,"available":9019090653184,"internally_reserved":0,"allocated":9334784,"data_stored":6165834,"data_compressed":114213,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":309580,"internal_metadata":330778292},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9205,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.437312"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347727+0000","last_change":"2026-02-13T03:45:24.355427+0000","last_active":"2026-02-13T03:45:25.347727+0000","last_peered":"2026-02-13T03:45:25.347727+0000","last_clean":"2026-02-13T03:45:25.347727+0000","last_became_active":"2026-02-13T03:45:24.354772+0000","last_became_peered":"2026-02-13T03:45:24.354772+0000","last_unstale":"2026-02-13T03:45:25.347727+0000","last_undegraded":"2026-02-13T03:45:25.347727+0000","last_fullsized":"2026-02-13T03:45:25.347727+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:09.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.354726+0000","last_change":"2026-02-13T03:45:24.354062+0000","last_active":"2026-02-13T03:45:24.354726+0000","last_peered":"2026-02-13T03:45:24.354726+0000","last_clean":"2026-02-13T03:45:24.354726+0000","last_became_active":"2026-02-13T03:45:24.353476+0000","last_became_peered":"2026-02-13T03:45:24.353476+0000","last_unstale":"2026-02-13T03:45:24.354726+0000","last_undegraded":"2026-02-13T03:45:24.354726+0000","last_fullsized":"2026-02-13T03:45:24.354726+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:35:46.107904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.354552+0000","last_change":"2026-02-13T03:45:24.353519+0000","last_active":"2026-02-13T03:45:24.354552+0000","last_peered":"2026-02-13T03:45:24.354552+0000","last_clean":"2026-02-13T03:45:24.354552+0000","last_became_active":"2026-02-13T03:45:24.352727+0000","last_became_peered":"2026-02-13T03:45:24.352727+0000","last_unstale":"2026-02-13T03:45:24.354552+0000","last_undegraded":"2026-02-13T03:45:24.354552+0000","last_fullsized":"2026-02-13T03:45:24.354552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:20.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348181+0000","last_change":"2026-02-13T03:45:24.353099+0000","last_active":"2026-02-13T03:45:25.348181+0000","last_peered":"2026-02-13T03:45:25.348181+0000","last_clean":"2026-02-13T03:45:25.348181+0000","last_became_active":"2026-02-13T03:45:24.352744+0000","last_became_peered":"2026-02-13T03:45:24.352744+0000","last_unstale":"2026-02-13T03:45:25.348181+0000","last_undegraded":"2026-02-13T03:45:25.348181+0000","last_fullsized":"2026-02-13T03:45:25.348181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:10:58.697391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927950+0000","last_change":"2026-02-13T03:45:24.352238+0000","last_active":"2026-02-13T03:45:25.927950+0000","last_peered":"2026-02-13T03:45:25.927950+0000","last_clean":"2026-02-13T03:45:25.927950+0000","last_became_active":"2026-02-13T03:45:24.352093+0000","last_became_peered":"2026-02-13T03:45:24.352093+0000","last_unstale":"2026-02-13T03:45:25.927950+0000","last_undegraded":"2026-02-13T03:45:25.927950+0000","last_fullsized":"2026-02-13T03:45:25.927950+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:40:14.634462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186270+0000","last_change":"2026-02-13T03:45:24.356372+0000","last_active":"2026-02-13T03:45:26.186270+0000","last_peered":"2026-02-13T03:45:26.186270+0000","last_clean":"2026-02-13T03:45:26.186270+0000","last_became_active":"2026-02-13T03:45:24.356087+0000","last_became_peered":"2026-02-13T03:45:24.356087+0000","last_unstale":"2026-02-13T03:45:26.186270+0000","last_undegraded":"2026-02-13T03:45:26.186270+0000","last_fullsized":"2026-02-13T03:45:26.186270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:35:30.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421404+0000","last_change":"2026-02-13T03:45:24.356259+0000","last_active":"2026-02-13T03:45:25.421404+0000","last_peered":"2026-02-13T03:45:25.421404+0000","last_clean":"2026-02-13T03:45:25.421404+0000","last_became_active":"2026-02-13T03:45:24.356054+0000","last_became_peered":"2026-02-13T03:45:24.356054+0000","last_unstale":"2026-02-13T03:45:25.421404+0000","last_undegraded":"2026-02-13T03:45:25.421404+0000","last_fullsized":"2026-02-13T03:45:25.421404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:41:54.530855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850055+0000","last_change":"2026-02-13T03:45:24.355402+0000","last_active":"2026-02-13T03:45:25.850055+0000","last_peered":"2026-02-13T03:45:25.850055+0000","last_clean":"2026-02-13T03:45:25.850055+0000","last_became_active":"2026-02-13T03:45:24.355240+0000","last_became_peered":"2026-02-13T03:45:24.355240+0000","last_unstale":"2026-02-13T03:45:25.850055+0000","last_undegraded":"2026-02-13T03:45:25.850055+0000","last_fullsized":"2026-02-13T03:45:25.850055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:41:11.797331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170279+0000","last_change":"2026-02-13T03:45:24.354542+0000","last_active":"2026-02-13T03:45:26.170279+0000","last_peered":"2026-02-13T03:45:26.170279+0000","last_clean":"2026-02-13T03:45:26.170279+0000","last_became_active":"2026-02-13T03:45:24.354387+0000","last_became_peered":"2026-02-13T03:45:24.354387+0000","last_unstale":"2026-02-13T03:45:26.170279+0000","last_undegraded":"2026-02-13T03:45:26.170279+0000","last_fullsized":"2026-02-13T03:45:26.170279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:45:32.036800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186512+0000","last_change":"2026-02-13T03:45:24.356533+0000","last_active":"2026-02-13T03:45:26.186512+0000","last_peered":"2026-02-13T03:45:26.186512+0000","last_clean":"2026-02-13T03:45:26.186512+0000","last_became_active":"2026-02-13T03:45:24.356262+0000","last_became_peered":"2026-02-13T03:45:24.356262+0000","last_unstale":"2026-02-13T03:45:26.186512+0000","last_undegraded":"2026-02-13T03:45:26.186512+0000","last_fullsized":"2026-02-13T03:45:26.186512+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:10:24.614545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421980+0000","last_change":"2026-02-13T03:45:24.354428+0000","last_active":"2026-02-13T03:45:25.421980+0000","last_peered":"2026-02-13T03:45:25.421980+0000","last_clean":"2026-02-13T03:45:25.421980+0000","last_became_active":"2026-02-13T03:45:24.354241+0000","last_became_peered":"2026-02-13T03:45:24.354241+0000","last_unstale":"2026-02-13T03:45:25.421980+0000","last_undegraded":"2026-02-13T03:45:25.421980+0000","last_fullsized":"2026-02-13T03:45:25.421980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:31.625314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348111+0000","last_change":"2026-02-13T03:45:24.353689+0000","last_active":"2026-02-13T03:45:25.348111+0000","last_peered":"2026-02-13T03:45:25.348111+0000","last_clean":"2026-02-13T03:45:25.348111+0000","last_became_active":"2026-02-13T03:45:24.353518+0000","last_became_peered":"2026-02-13T03:45:24.353518+0000","last_unstale":"2026-02-13T03:45:25.348111+0000","last_undegraded":"2026-02-13T03:45:25.348111+0000","last_fullsized":"2026-02-13T03:45:25.348111+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:20:01.588601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186445+0000","last_change":"2026-02-13T03:45:24.353765+0000","last_active":"2026-02-13T03:45:26.186445+0000","last_peered":"2026-02-13T03:45:26.186445+0000","last_clean":"2026-02-13T03:45:26.186445+0000","last_became_active":"2026-02-13T03:45:24.353522+0000","last_became_peered":"2026-02-13T03:45:24.353522+0000","last_unstale":"2026-02-13T03:45:26.186445+0000","last_undegraded":"2026-02-13T03:45:26.186445+0000","last_fullsized":"2026-02-13T03:45:26.186445+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:46:34.122311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.354679+0000","last_change":"2026-02-13T03:45:24.353969+0000","last_active":"2026-02-13T03:45:24.354679+0000","last_peered":"2026-02-13T03:45:24.354679+0000","last_clean":"2026-02-13T03:45:24.354679+0000","last_became_active":"2026-02-13T03:45:24.353461+0000","last_became_peered":"2026-02-13T03:45:24.353461+0000","last_unstale":"2026-02-13T03:45:24.354679+0000","last_undegraded":"2026-02-13T03:45:24.354679+0000","last_fullsized":"2026-02-13T03:45:24.354679+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:22.344391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.349983+0000","last_change":"2026-02-13T03:45:24.349803+0000","last_active":"2026-02-13T03:45:24.349983+0000","last_peered":"2026-02-13T03:45:24.349983+0000","last_clean":"2026-02-13T03:45:24.349983+0000","last_became_active":"2026-02-13T03:45:24.349591+0000","last_became_peered":"2026-02-13T03:45:24.349591+0000","last_unstale":"2026-02-13T03:45:24.349983+0000","last_undegraded":"2026-02-13T03:45:24.349983+0000","last_fullsized":"2026-02-13T03:45:24.349983+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:30:43.396676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170120+0000","last_change":"2026-02-13T03:45:24.353411+0000","last_active":"2026-02-13T03:45:26.170120+0000","last_peered":"2026-02-13T03:45:26.170120+0000","last_clean":"2026-02-13T03:45:26.170120+0000","last_became_active":"2026-02-13T03:45:24.353278+0000","last_became_peered":"2026-02-13T03:45:24.353278+0000","last_unstale":"2026-02-13T03:45:26.170120+0000","last_undegraded":"2026-02-13T03:45:26.170120+0000","last_fullsized":"2026-02-13T03:45:26.170120+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:49.049280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347746+0000","last_change":"2026-02-13T03:45:24.355567+0000","last_active":"2026-02-13T03:45:25.347746+0000","last_peered":"2026-02-13T03:45:25.347746+0000","last_clean":"2026-02-13T03:45:25.347746+0000","last_became_active":"2026-02-13T03:45:24.354971+0000","last_became_peered":"2026-02-13T03:45:24.354971+0000","last_unstale":"2026-02-13T03:45:25.347746+0000","last_undegraded":"2026-02-13T03:45:25.347746+0000","last_fullsized":"2026-02-13T03:45:25.347746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:35:23.426524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347236+0000","last_change":"2026-02-13T03:45:24.355317+0000","last_active":"2026-02-13T03:45:25.347236+0000","last_peered":"2026-02-13T03:45:25.347236+0000","last_clean":"2026-02-13T03:45:25.347236+0000","last_became_active":"2026-02-13T03:45:24.355131+0000","last_became_peered":"2026-02-13T03:45:24.355131+0000","last_unstale":"2026-02-13T03:45:25.347236+0000","last_undegraded":"2026-02-13T03:45:25.347236+0000","last_fullsized":"2026-02-13T03:45:25.347236+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:02.617097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186145+0000","last_change":"2026-02-13T03:45:24.354455+0000","last_active":"2026-02-13T03:45:26.186145+0000","last_peered":"2026-02-13T03:45:26.186145+0000","last_clean":"2026-02-13T03:45:26.186145+0000","last_became_active":"2026-02-13T03:45:24.353604+0000","last_became_peered":"2026-02-13T03:45:24.353604+0000","last_unstale":"2026-02-13T03:45:26.186145+0000","last_undegraded":"2026-02-13T03:45:26.186145+0000","last_fullsized":"2026-02-13T03:45:26.186145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:48:18.147862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347614+0000","last_change":"2026-02-13T03:45:24.353184+0000","last_active":"2026-02-13T03:45:25.347614+0000","last_peered":"2026-02-13T03:45:25.347614+0000","last_clean":"2026-02-13T03:45:25.347614+0000","last_became_active":"2026-02-13T03:45:24.352982+0000","last_became_peered":"2026-02-13T03:45:24.352982+0000","last_unstale":"2026-02-13T03:45:25.347614+0000","last_undegraded":"2026-02-13T03:45:25.347614+0000","last_fullsized":"2026-02-13T03:45:25.347614+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:42.997383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186389+0000","last_change":"2026-02-13T03:45:24.353667+0000","last_active":"2026-02-13T03:45:26.186389+0000","last_peered":"2026-02-13T03:45:26.186389+0000","last_clean":"2026-02-13T03:45:26.186389+0000","last_became_active":"2026-02-13T03:45:24.353361+0000","last_became_peered":"2026-02-13T03:45:24.353361+0000","last_unstale":"2026-02-13T03:45:26.186389+0000","last_undegraded":"2026-02-13T03:45:26.186389+0000","last_fullsized":"2026-02-13T03:45:26.186389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:56:51.287334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170246+0000","last_change":"2026-02-13T03:45:24.354416+0000","last_active":"2026-02-13T03:45:26.170246+0000","last_peered":"2026-02-13T03:45:26.170246+0000","last_clean":"2026-02-13T03:45:26.170246+0000","last_became_active":"2026-02-13T03:45:24.354207+0000","last_became_peered":"2026-02-13T03:45:24.354207+0000","last_unstale":"2026-02-13T03:45:26.170246+0000","last_undegraded":"2026-02-13T03:45:26.170246+0000","last_fullsized":"2026-02-13T03:45:26.170246+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:06:10.307319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850064+0000","last_change":"2026-02-13T03:45:24.354597+0000","last_active":"2026-02-13T03:45:25.850064+0000","last_peered":"2026-02-13T03:45:25.850064+0000","last_clean":"2026-02-13T03:45:25.850064+0000","last_became_active":"2026-02-13T03:45:24.354310+0000","last_became_peered":"2026-02-13T03:45:24.354310+0000","last_unstale":"2026-02-13T03:45:25.850064+0000","last_undegraded":"2026-02-13T03:45:25.850064+0000","last_fullsized":"2026-02-13T03:45:25.850064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:55.801674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791080+0000","last_change":"2026-02-13T03:45:24.355114+0000","last_active":"2026-02-13T03:45:25.791080+0000","last_peered":"2026-02-13T03:45:25.791080+0000","last_clean":"2026-02-13T03:45:25.791080+0000","last_became_active":"2026-02-13T03:45:24.353783+0000","last_became_peered":"2026-02-13T03:45:24.353783+0000","last_unstale":"2026-02-13T03:45:25.791080+0000","last_undegraded":"2026-02-13T03:45:25.791080+0000","last_fullsized":"2026-02-13T03:45:25.791080+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:42.747894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850333+0000","last_change":"2026-02-13T03:45:24.356301+0000","last_active":"2026-02-13T03:45:25.850333+0000","last_peered":"2026-02-13T03:45:25.850333+0000","last_clean":"2026-02-13T03:45:25.850333+0000","last_became_active":"2026-02-13T03:45:24.356101+0000","last_became_peered":"2026-02-13T03:45:24.356101+0000","last_unstale":"2026-02-13T03:45:25.850333+0000","last_undegraded":"2026-02-13T03:45:25.850333+0000","last_fullsized":"2026-02-13T03:45:25.850333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:02:39.812365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186262+0000","last_change":"2026-02-13T03:45:24.354631+0000","last_active":"2026-02-13T03:45:26.186262+0000","last_peered":"2026-02-13T03:45:26.186262+0000","last_clean":"2026-02-13T03:45:26.186262+0000","last_became_active":"2026-02-13T03:45:24.354306+0000","last_became_peered":"2026-02-13T03:45:24.354306+0000","last_unstale":"2026-02-13T03:45:26.186262+0000","last_undegraded":"2026-02-13T03:45:26.186262+0000","last_fullsized":"2026-02-13T03:45:26.186262+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:57.612589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347635+0000","last_change":"2026-02-13T03:45:24.354688+0000","last_active":"2026-02-13T03:45:25.347635+0000","last_peered":"2026-02-13T03:45:25.347635+0000","last_clean":"2026-02-13T03:45:25.347635+0000","last_became_active":"2026-02-13T03:45:24.354555+0000","last_became_peered":"2026-02-13T03:45:24.354555+0000","last_unstale":"2026-02-13T03:45:25.347635+0000","last_undegraded":"2026-02-13T03:45:25.347635+0000","last_fullsized":"2026-02-13T03:45:25.347635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:25.329082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186328+0000","last_change":"2026-02-13T03:45:24.349557+0000","last_active":"2026-02-13T03:45:26.186328+0000","last_peered":"2026-02-13T03:45:26.186328+0000","last_clean":"2026-02-13T03:45:26.186328+0000","last_became_active":"2026-02-13T03:45:24.349043+0000","last_became_peered":"2026-02-13T03:45:24.349043+0000","last_unstale":"2026-02-13T03:45:26.186328+0000","last_undegraded":"2026-02-13T03:45:26.186328+0000","last_fullsized":"2026-02-13T03:45:26.186328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:43.058296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.349914+0000","last_change":"2026-02-13T03:45:24.349552+0000","last_active":"2026-02-13T03:45:24.349914+0000","last_peered":"2026-02-13T03:45:24.349914+0000","last_clean":"2026-02-13T03:45:24.349914+0000","last_became_active":"2026-02-13T03:45:24.349020+0000","last_became_peered":"2026-02-13T03:45:24.349020+0000","last_unstale":"2026-02-13T03:45:24.349914+0000","last_undegraded":"2026-02-13T03:45:24.349914+0000","last_fullsized":"2026-02-13T03:45:24.349914+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:12.323059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.185956+0000","last_change":"2026-02-13T03:45:24.354554+0000","last_active":"2026-02-13T03:45:26.185956+0000","last_peered":"2026-02-13T03:45:26.185956+0000","last_clean":"2026-02-13T03:45:26.185956+0000","last_became_active":"2026-02-13T03:45:24.353925+0000","last_became_peered":"2026-02-13T03:45:24.353925+0000","last_unstale":"2026-02-13T03:45:26.185956+0000","last_undegraded":"2026-02-13T03:45:26.185956+0000","last_fullsized":"2026-02-13T03:45:26.185956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:30:45.125643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186026+0000","last_change":"2026-02-13T03:45:24.355744+0000","last_active":"2026-02-13T03:45:26.186026+0000","last_peered":"2026-02-13T03:45:26.186026+0000","last_clean":"2026-02-13T03:45:26.186026+0000","last_became_active":"2026-02-13T03:45:24.355532+0000","last_became_peered":"2026-02-13T03:45:24.355532+0000","last_unstale":"2026-02-13T03:45:26.186026+0000","last_undegraded":"2026-02-13T03:45:26.186026+0000","last_fullsized":"2026-02-13T03:45:26.186026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:35:14.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347444+0000","last_change":"2026-02-13T03:45:24.355681+0000","last_active":"2026-02-13T03:45:25.347444+0000","last_peered":"2026-02-13T03:45:25.347444+0000","last_clean":"2026-02-13T03:45:25.347444+0000","last_became_active":"2026-02-13T03:45:24.355539+0000","last_became_peered":"2026-02-13T03:45:24.355539+0000","last_unstale":"2026-02-13T03:45:25.347444+0000","last_undegraded":"2026-02-13T03:45:25.347444+0000","last_fullsized":"2026-02-13T03:45:25.347444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:14:16.800666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927954+0000","last_change":"2026-02-13T03:45:24.353034+0000","last_active":"2026-02-13T03:45:25.927954+0000","last_peered":"2026-02-13T03:45:25.927954+0000","last_clean":"2026-02-13T03:45:25.927954+0000","last_became_active":"2026-02-13T03:45:24.352925+0000","last_became_peered":"2026-02-13T03:45:24.352925+0000","last_unstale":"2026-02-13T03:45:25.927954+0000","last_undegraded":"2026-02-13T03:45:25.927954+0000","last_fullsized":"2026-02-13T03:45:25.927954+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:29:42.354130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791049+0000","last_change":"2026-02-13T03:45:23.349400+0000","last_active":"2026-02-13T03:45:25.791049+0000","last_peered":"2026-02-13T03:45:25.791049+0000","last_clean":"2026-02-13T03:45:25.791049+0000","last_became_active":"2026-02-13T03:45:23.349283+0000","last_became_peered":"2026-02-13T03:45:23.349283+0000","last_unstale":"2026-02-13T03:45:25.791049+0000","last_undegraded":"2026-02-13T03:45:25.791049+0000","last_fullsized":"2026-02-13T03:45:25.791049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:43:46.907002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791094+0000","last_change":"2026-02-13T03:45:24.354044+0000","last_active":"2026-02-13T03:45:25.791094+0000","last_peered":"2026-02-13T03:45:25.791094+0000","last_clean":"2026-02-13T03:45:25.791094+0000","last_became_active":"2026-02-13T03:45:24.353314+0000","last_became_peered":"2026-02-13T03:45:24.353314+0000","last_unstale":"2026-02-13T03:45:25.791094+0000","last_undegraded":"2026-02-13T03:45:25.791094+0000","last_fullsized":"2026-02-13T03:45:25.791094+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:21:37.422406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186240+0000","last_change":"2026-02-13T03:45:23.349077+0000","last_active":"2026-02-13T03:45:26.186240+0000","last_peered":"2026-02-13T03:45:26.186240+0000","last_clean":"2026-02-13T03:45:26.186240+0000","last_became_active":"2026-02-13T03:45:23.348867+0000","last_became_peered":"2026-02-13T03:45:23.348867+0000","last_unstale":"2026-02-13T03:45:26.186240+0000","last_undegraded":"2026-02-13T03:45:26.186240+0000","last_fullsized":"2026-02-13T03:45:26.186240+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:47:13.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186082+0000","last_change":"2026-02-13T03:45:23.350107+0000","last_active":"2026-02-13T03:45:26.186082+0000","last_peered":"2026-02-13T03:45:26.186082+0000","last_clean":"2026-02-13T03:45:26.186082+0000","last_became_active":"2026-02-13T03:45:23.349864+0000","last_became_peered":"2026-02-13T03:45:23.349864+0000","last_unstale":"2026-02-13T03:45:26.186082+0000","last_undegraded":"2026-02-13T03:45:26.186082+0000","last_fullsized":"2026-02-13T03:45:26.186082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:12:31.503069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850113+0000","last_change":"2026-02-13T03:45:24.353268+0000","last_active":"2026-02-13T03:45:25.850113+0000","last_peered":"2026-02-13T03:45:25.850113+0000","last_clean":"2026-02-13T03:45:25.850113+0000","last_became_active":"2026-02-13T03:45:24.352994+0000","last_became_peered":"2026-02-13T03:45:24.352994+0000","last_unstale":"2026-02-13T03:45:25.850113+0000","last_undegraded":"2026-02-13T03:45:25.850113+0000","last_fullsized":"2026-02-13T03:45:25.850113+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:34.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791178+0000","last_change":"2026-02-13T03:45:23.348540+0000","last_active":"2026-02-13T03:45:25.791178+0000","last_peered":"2026-02-13T03:45:25.791178+0000","last_clean":"2026-02-13T03:45:25.791178+0000","last_became_active":"2026-02-13T03:45:23.348169+0000","last_became_peered":"2026-02-13T03:45:23.348169+0000","last_unstale":"2026-02-13T03:45:25.791178+0000","last_undegraded":"2026-02-13T03:45:25.791178+0000","last_fullsized":"2026-02-13T03:45:25.791178+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:41:37.655572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347232+0000","last_change":"2026-02-13T03:45:24.354464+0000","last_active":"2026-02-13T03:45:25.347232+0000","last_peered":"2026-02-13T03:45:25.347232+0000","last_clean":"2026-02-13T03:45:25.347232+0000","last_became_active":"2026-02-13T03:45:24.354209+0000","last_became_peered":"2026-02-13T03:45:24.354209+0000","last_unstale":"2026-02-13T03:45:25.347232+0000","last_undegraded":"2026-02-13T03:45:25.347232+0000","last_fullsized":"2026-02-13T03:45:25.347232+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:45:06.054136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186496+0000","last_change":"2026-02-13T03:45:23.349686+0000","last_active":"2026-02-13T03:45:26.186496+0000","last_peered":"2026-02-13T03:45:26.186496+0000","last_clean":"2026-02-13T03:45:26.186496+0000","last_became_active":"2026-02-13T03:45:23.349198+0000","last_became_peered":"2026-02-13T03:45:23.349198+0000","last_unstale":"2026-02-13T03:45:26.186496+0000","last_undegraded":"2026-02-13T03:45:26.186496+0000","last_fullsized":"2026-02-13T03:45:26.186496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:57:46.527371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170290+0000","last_change":"2026-02-13T03:45:24.355581+0000","last_active":"2026-02-13T03:45:26.170290+0000","last_peered":"2026-02-13T03:45:26.170290+0000","last_clean":"2026-02-13T03:45:26.170290+0000","last_became_active":"2026-02-13T03:45:24.355429+0000","last_became_peered":"2026-02-13T03:45:24.355429+0000","last_unstale":"2026-02-13T03:45:26.170290+0000","last_undegraded":"2026-02-13T03:45:26.170290+0000","last_fullsized":"2026-02-13T03:45:26.170290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:49:00.947016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421822+0000","last_change":"2026-02-13T03:45:23.350353+0000","last_active":"2026-02-13T03:45:25.421822+0000","last_peered":"2026-02-13T03:45:25.421822+0000","last_clean":"2026-02-13T03:45:25.421822+0000","last_became_active":"2026-02-13T03:45:23.349728+0000","last_became_peered":"2026-02-13T03:45:23.349728+0000","last_unstale":"2026-02-13T03:45:25.421822+0000","last_undegraded":"2026-02-13T03:45:25.421822+0000","last_fullsized":"2026-02-13T03:45:25.421822+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:21:58.252825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.355286+0000","last_change":"2026-02-13T03:45:24.355069+0000","last_active":"2026-02-13T03:45:24.355286+0000","last_peered":"2026-02-13T03:45:24.355286+0000","last_clean":"2026-02-13T03:45:24.355286+0000","last_became_active":"2026-02-13T03:45:24.354927+0000","last_became_peered":"2026-02-13T03:45:24.354927+0000","last_unstale":"2026-02-13T03:45:24.355286+0000","last_undegraded":"2026-02-13T03:45:24.355286+0000","last_fullsized":"2026-02-13T03:45:24.355286+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:54:58.099532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"69'3","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791069+0000","last_change":"2026-02-13T03:45:23.352479+0000","last_active":"2026-02-13T03:45:25.791069+0000","last_peered":"2026-02-13T03:45:25.791069+0000","last_clean":"2026-02-13T03:45:25.791069+0000","last_became_active":"2026-02-13T03:45:23.352227+0000","last_became_peered":"2026-02-13T03:45:23.352227+0000","last_unstale":"2026-02-13T03:45:25.791069+0000","last_undegraded":"2026-02-13T03:45:25.791069+0000","last_fullsized":"2026-02-13T03:45:25.791069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:24:25.395518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170237+0000","last_change":"2026-02-13T03:45:24.353602+0000","last_active":"2026-02-13T03:45:26.170237+0000","last_peered":"2026-02-13T03:45:26.170237+0000","last_clean":"2026-02-13T03:45:26.170237+0000","last_became_active":"2026-02-13T03:45:24.352872+0000","last_became_peered":"2026-02-13T03:45:24.352872+0000","last_unstale":"2026-02-13T03:45:26.170237+0000","last_undegraded":"2026-02-13T03:45:26.170237+0000","last_fullsized":"2026-02-13T03:45:26.170237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:38.831095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"70'9","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:28.327680+0000","last_change":"2026-02-13T03:45:23.349666+0000","last_active":"2026-02-13T03:45:28.327680+0000","last_peered":"2026-02-13T03:45:28.327680+0000","last_clean":"2026-02-13T03:45:28.327680+0000","last_became_active":"2026-02-13T03:45:23.349482+0000","last_became_peered":"2026-02-13T03:45:23.349482+0000","last_unstale":"2026-02-13T03:45:28.327680+0000","last_undegraded":"2026-02-13T03:45:28.327680+0000","last_fullsized":"2026-02-13T03:45:28.327680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:36.983368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928003+0000","last_change":"2026-02-13T03:45:24.352564+0000","last_active":"2026-02-13T03:45:25.928003+0000","last_peered":"2026-02-13T03:45:25.928003+0000","last_clean":"2026-02-13T03:45:25.928003+0000","last_became_active":"2026-02-13T03:45:24.352442+0000","last_became_peered":"2026-02-13T03:45:24.352442+0000","last_unstale":"2026-02-13T03:45:25.928003+0000","last_undegraded":"2026-02-13T03:45:25.928003+0000","last_fullsized":"2026-02-13T03:45:25.928003+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:40:35.470403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"69'2","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186086+0000","last_change":"2026-02-13T03:45:23.349943+0000","last_active":"2026-02-13T03:45:26.186086+0000","last_peered":"2026-02-13T03:45:26.186086+0000","last_clean":"2026-02-13T03:45:26.186086+0000","last_became_active":"2026-02-13T03:45:23.349747+0000","last_became_peered":"2026-02-13T03:45:23.349747+0000","last_unstale":"2026-02-13T03:45:26.186086+0000","last_undegraded":"2026-02-13T03:45:26.186086+0000","last_fullsized":"2026-02-13T03:45:26.186086+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:46:29.724224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186270+0000","last_change":"2026-02-13T03:45:24.353731+0000","last_active":"2026-02-13T03:45:26.186270+0000","last_peered":"2026-02-13T03:45:26.186270+0000","last_clean":"2026-02-13T03:45:26.186270+0000","last_became_active":"2026-02-13T03:45:24.353367+0000","last_became_peered":"2026-02-13T03:45:24.353367+0000","last_unstale":"2026-02-13T03:45:26.186270+0000","last_undegraded":"2026-02-13T03:45:26.186270+0000","last_fullsized":"2026-02-13T03:45:26.186270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:23:13.530630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.790926+0000","last_change":"2026-02-13T03:45:23.348565+0000","last_active":"2026-02-13T03:45:25.790926+0000","last_peered":"2026-02-13T03:45:25.790926+0000","last_clean":"2026-02-13T03:45:25.790926+0000","last_became_active":"2026-02-13T03:45:23.348280+0000","last_became_peered":"2026-02-13T03:45:23.348280+0000","last_unstale":"2026-02-13T03:45:25.790926+0000","last_undegraded":"2026-02-13T03:45:25.790926+0000","last_fullsized":"2026-02-13T03:45:25.790926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:55:08.236742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421805+0000","last_change":"2026-02-13T03:45:24.353067+0000","last_active":"2026-02-13T03:45:25.421805+0000","last_peered":"2026-02-13T03:45:25.421805+0000","last_clean":"2026-02-13T03:45:25.421805+0000","last_became_active":"2026-02-13T03:45:24.352535+0000","last_became_peered":"2026-02-13T03:45:24.352535+0000","last_unstale":"2026-02-13T03:45:25.421805+0000","last_undegraded":"2026-02-13T03:45:25.421805+0000","last_fullsized":"2026-02-13T03:45:25.421805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:19.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347856+0000","last_change":"2026-02-13T03:45:23.349989+0000","last_active":"2026-02-13T03:45:25.347856+0000","last_peered":"2026-02-13T03:45:25.347856+0000","last_clean":"2026-02-13T03:45:25.347856+0000","last_became_active":"2026-02-13T03:45:23.349774+0000","last_became_peered":"2026-02-13T03:45:23.349774+0000","last_unstale":"2026-02-13T03:45:25.347856+0000","last_undegraded":"2026-02-13T03:45:25.347856+0000","last_fullsized":"2026-02-13T03:45:25.347856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:10.402322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421339+0000","last_change":"2026-02-13T03:45:24.356431+0000","last_active":"2026-02-13T03:45:25.421339+0000","last_peered":"2026-02-13T03:45:25.421339+0000","last_clean":"2026-02-13T03:45:25.421339+0000","last_became_active":"2026-02-13T03:45:24.355854+0000","last_became_peered":"2026-02-13T03:45:24.355854+0000","last_unstale":"2026-02-13T03:45:25.421339+0000","last_undegraded":"2026-02-13T03:45:25.421339+0000","last_fullsized":"2026-02-13T03:45:25.421339+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:23:56.021478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"69'8","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927749+0000","last_change":"2026-02-13T03:45:23.352300+0000","last_active":"2026-02-13T03:45:25.927749+0000","last_peered":"2026-02-13T03:45:25.927749+0000","last_clean":"2026-02-13T03:45:25.927749+0000","last_became_active":"2026-02-13T03:45:23.352176+0000","last_became_peered":"2026-02-13T03:45:23.352176+0000","last_unstale":"2026-02-13T03:45:25.927749+0000","last_undegraded":"2026-02-13T03:45:25.927749+0000","last_fullsized":"2026-02-13T03:45:25.927749+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:56.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791150+0000","last_change":"2026-02-13T03:45:24.355963+0000","last_active":"2026-02-13T03:45:25.791150+0000","last_peered":"2026-02-13T03:45:25.791150+0000","last_clean":"2026-02-13T03:45:25.791150+0000","last_became_active":"2026-02-13T03:45:24.354819+0000","last_became_peered":"2026-02-13T03:45:24.354819+0000","last_unstale":"2026-02-13T03:45:25.791150+0000","last_undegraded":"2026-02-13T03:45:25.791150+0000","last_fullsized":"2026-02-13T03:45:25.791150+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:23:36.255505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"69'1","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928091+0000","last_change":"2026-02-13T03:45:23.346399+0000","last_active":"2026-02-13T03:45:25.928091+0000","last_peered":"2026-02-13T03:45:25.928091+0000","last_clean":"2026-02-13T03:45:25.928091+0000","last_became_active":"2026-02-13T03:45:23.346195+0000","last_became_peered":"2026-02-13T03:45:23.346195+0000","last_unstale":"2026-02-13T03:45:25.928091+0000","last_undegraded":"2026-02-13T03:45:25.928091+0000","last_fullsized":"2026-02-13T03:45:25.928091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:40:17.923580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347701+0000","last_change":"2026-02-13T03:45:24.355093+0000","last_active":"2026-02-13T03:45:25.347701+0000","last_peered":"2026-02-13T03:45:25.347701+0000","last_clean":"2026-02-13T03:45:25.347701+0000","last_became_active":"2026-02-13T03:45:24.354967+0000","last_became_peered":"2026-02-13T03:45:24.354967+0000","last_unstale":"2026-02-13T03:45:25.347701+0000","last_undegraded":"2026-02-13T03:45:25.347701+0000","last_fullsized":"2026-02-13T03:45:25.347701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:47.555133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186318+0000","last_change":"2026-02-13T03:45:23.350209+0000","last_active":"2026-02-13T03:45:26.186318+0000","last_peered":"2026-02-13T03:45:26.186318+0000","last_clean":"2026-02-13T03:45:26.186318+0000","last_became_active":"2026-02-13T03:45:23.349865+0000","last_became_peered":"2026-02-13T03:45:23.349865+0000","last_unstale":"2026-02-13T03:45:26.186318+0000","last_undegraded":"2026-02-13T03:45:26.186318+0000","last_fullsized":"2026-02-13T03:45:26.186318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:31:13.959587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.422025+0000","last_change":"2026-02-13T03:45:24.353947+0000","last_active":"2026-02-13T03:45:25.422025+0000","last_peered":"2026-02-13T03:45:25.422025+0000","last_clean":"2026-02-13T03:45:25.422025+0000","last_became_active":"2026-02-13T03:45:24.353550+0000","last_became_peered":"2026-02-13T03:45:24.353550+0000","last_unstale":"2026-02-13T03:45:25.422025+0000","last_undegraded":"2026-02-13T03:45:25.422025+0000","last_fullsized":"2026-02-13T03:45:25.422025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:39.579793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791199+0000","last_change":"2026-02-13T03:45:23.347676+0000","last_active":"2026-02-13T03:45:25.791199+0000","last_peered":"2026-02-13T03:45:25.791199+0000","last_clean":"2026-02-13T03:45:25.791199+0000","last_became_active":"2026-02-13T03:45:23.347440+0000","last_became_peered":"2026-02-13T03:45:23.347440+0000","last_unstale":"2026-02-13T03:45:25.791199+0000","last_undegraded":"2026-02-13T03:45:25.791199+0000","last_fullsized":"2026-02-13T03:45:25.791199+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:57:40.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421808+0000","last_change":"2026-02-13T03:45:24.356079+0000","last_active":"2026-02-13T03:45:25.421808+0000","last_peered":"2026-02-13T03:45:25.421808+0000","last_clean":"2026-02-13T03:45:25.421808+0000","last_became_active":"2026-02-13T03:45:24.355776+0000","last_became_peered":"2026-02-13T03:45:24.355776+0000","last_unstale":"2026-02-13T03:45:25.421808+0000","last_undegraded":"2026-02-13T03:45:25.421808+0000","last_fullsized":"2026-02-13T03:45:25.421808+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:06.447768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186148+0000","last_change":"2026-02-13T03:45:23.352633+0000","last_active":"2026-02-13T03:45:26.186148+0000","last_peered":"2026-02-13T03:45:26.186148+0000","last_clean":"2026-02-13T03:45:26.186148+0000","last_became_active":"2026-02-13T03:45:23.352460+0000","last_became_peered":"2026-02-13T03:45:23.352460+0000","last_unstale":"2026-02-13T03:45:26.186148+0000","last_undegraded":"2026-02-13T03:45:26.186148+0000","last_fullsized":"2026-02-13T03:45:26.186148+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:59.397129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.422048+0000","last_change":"2026-02-13T03:45:24.353603+0000","last_active":"2026-02-13T03:45:25.422048+0000","last_peered":"2026-02-13T03:45:25.422048+0000","last_clean":"2026-02-13T03:45:25.422048+0000","last_became_active":"2026-02-13T03:45:24.353292+0000","last_became_peered":"2026-02-13T03:45:24.353292+0000","last_unstale":"2026-02-13T03:45:25.422048+0000","last_undegraded":"2026-02-13T03:45:25.422048+0000","last_fullsized":"2026-02-13T03:45:25.422048+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:04:30.019967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'152","reported_seq":336,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421413+0000","last_change":"2026-02-13T03:45:01.868042+0000","last_active":"2026-02-13T03:45:25.421413+0000","last_peered":"2026-02-13T03:45:25.421413+0000","last_clean":"2026-02-13T03:45:25.421413+0000","last_became_active":"2026-02-13T03:45:01.867747+0000","last_became_peered":"2026-02-13T03:45:01.867747+0000","last_unstale":"2026-02-13T03:45:25.421413+0000","last_undegraded":"2026-02-13T03:45:25.421413+0000","last_fullsized":"2026-02-13T03:45:25.421413+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:43:59.641267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:43:59.641267+0000","last_clean_scrub_stamp":"2026-02-13T03:43:59.641267+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:48:43.238019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347838+0000","last_change":"2026-02-13T03:45:23.349113+0000","last_active":"2026-02-13T03:45:25.347838+0000","last_peered":"2026-02-13T03:45:25.347838+0000","last_clean":"2026-02-13T03:45:25.347838+0000","last_became_active":"2026-02-13T03:45:23.348948+0000","last_became_peered":"2026-02-13T03:45:23.348948+0000","last_unstale":"2026-02-13T03:45:25.347838+0000","last_undegraded":"2026-02-13T03:45:25.347838+0000","last_fullsized":"2026-02-13T03:45:25.347838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:00:41.357000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850169+0000","last_change":"2026-02-13T03:45:24.354838+0000","last_active":"2026-02-13T03:45:25.850169+0000","last_peered":"2026-02-13T03:45:25.850169+0000","last_clean":"2026-02-13T03:45:25.850169+0000","last_became_active":"2026-02-13T03:45:24.354639+0000","last_became_peered":"2026-02-13T03:45:24.354639+0000","last_unstale":"2026-02-13T03:45:25.850169+0000","last_undegraded":"2026-02-13T03:45:25.850169+0000","last_fullsized":"2026-02-13T03:45:25.850169+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:22.121456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421381+0000","last_change":"2026-02-13T03:45:23.349837+0000","last_active":"2026-02-13T03:45:25.421381+0000","last_peered":"2026-02-13T03:45:25.421381+0000","last_clean":"2026-02-13T03:45:25.421381+0000","last_became_active":"2026-02-13T03:45:23.349223+0000","last_became_peered":"2026-02-13T03:45:23.349223+0000","last_unstale":"2026-02-13T03:45:25.421381+0000","last_undegraded":"2026-02-13T03:45:25.421381+0000","last_fullsized":"2026-02-13T03:45:25.421381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:38:18.742824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186170+0000","last_change":"2026-02-13T03:45:24.349832+0000","last_active":"2026-02-13T03:45:26.186170+0000","last_peered":"2026-02-13T03:45:26.186170+0000","last_clean":"2026-02-13T03:45:26.186170+0000","last_became_active":"2026-02-13T03:45:24.349608+0000","last_became_peered":"2026-02-13T03:45:24.349608+0000","last_unstale":"2026-02-13T03:45:26.186170+0000","last_undegraded":"2026-02-13T03:45:26.186170+0000","last_fullsized":"2026-02-13T03:45:26.186170+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:45:53.372675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186175+0000","last_change":"2026-02-13T03:45:23.352560+0000","last_active":"2026-02-13T03:45:26.186175+0000","last_peered":"2026-02-13T03:45:26.186175+0000","last_clean":"2026-02-13T03:45:26.186175+0000","last_became_active":"2026-02-13T03:45:23.352373+0000","last_became_peered":"2026-02-13T03:45:23.352373+0000","last_unstale":"2026-02-13T03:45:26.186175+0000","last_undegraded":"2026-02-13T03:45:26.186175+0000","last_fullsized":"2026-02-13T03:45:26.186175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:13:31.193029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791006+0000","last_change":"2026-02-13T03:45:24.354558+0000","last_active":"2026-02-13T03:45:25.791006+0000","last_peered":"2026-02-13T03:45:25.791006+0000","last_clean":"2026-02-13T03:45:25.791006+0000","last_became_active":"2026-02-13T03:45:24.354213+0000","last_became_peered":"2026-02-13T03:45:24.354213+0000","last_unstale":"2026-02-13T03:45:25.791006+0000","last_undegraded":"2026-02-13T03:45:25.791006+0000","last_fullsized":"2026-02-13T03:45:25.791006+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:21.319355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421761+0000","last_change":"2026-02-13T03:45:23.350556+0000","last_active":"2026-02-13T03:45:25.421761+0000","last_peered":"2026-02-13T03:45:25.421761+0000","last_clean":"2026-02-13T03:45:25.421761+0000","last_became_active":"2026-02-13T03:45:23.349778+0000","last_became_peered":"2026-02-13T03:45:23.349778+0000","last_unstale":"2026-02-13T03:45:25.421761+0000","last_undegraded":"2026-02-13T03:45:25.421761+0000","last_fullsized":"2026-02-13T03:45:25.421761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:30:14.999945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186456+0000","last_change":"2026-02-13T03:45:24.356662+0000","last_active":"2026-02-13T03:45:26.186456+0000","last_peered":"2026-02-13T03:45:26.186456+0000","last_clean":"2026-02-13T03:45:26.186456+0000","last_became_active":"2026-02-13T03:45:24.356145+0000","last_became_peered":"2026-02-13T03:45:24.356145+0000","last_unstale":"2026-02-13T03:45:26.186456+0000","last_undegraded":"2026-02-13T03:45:26.186456+0000","last_fullsized":"2026-02-13T03:45:26.186456+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:52.281060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347168+0000","last_change":"2026-02-13T03:45:23.351917+0000","last_active":"2026-02-13T03:45:25.347168+0000","last_peered":"2026-02-13T03:45:25.347168+0000","last_clean":"2026-02-13T03:45:25.347168+0000","last_became_active":"2026-02-13T03:45:23.351794+0000","last_became_peered":"2026-02-13T03:45:23.351794+0000","last_unstale":"2026-02-13T03:45:25.347168+0000","last_undegraded":"2026-02-13T03:45:25.347168+0000","last_fullsized":"2026-02-13T03:45:25.347168+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:15.488304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186459+0000","last_change":"2026-02-13T03:45:24.352772+0000","last_active":"2026-02-13T03:45:26.186459+0000","last_peered":"2026-02-13T03:45:26.186459+0000","last_clean":"2026-02-13T03:45:26.186459+0000","last_became_active":"2026-02-13T03:45:24.352569+0000","last_became_peered":"2026-02-13T03:45:24.352569+0000","last_unstale":"2026-02-13T03:45:26.186459+0000","last_undegraded":"2026-02-13T03:45:26.186459+0000","last_fullsized":"2026-02-13T03:45:26.186459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:33:13.188588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928147+0000","last_change":"2026-02-13T03:45:23.352357+0000","last_active":"2026-02-13T03:45:25.928147+0000","last_peered":"2026-02-13T03:45:25.928147+0000","last_clean":"2026-02-13T03:45:25.928147+0000","last_became_active":"2026-02-13T03:45:23.352192+0000","last_became_peered":"2026-02-13T03:45:23.352192+0000","last_unstale":"2026-02-13T03:45:25.928147+0000","last_undegraded":"2026-02-13T03:45:25.928147+0000","last_fullsized":"2026-02-13T03:45:25.928147+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:07:52.352111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186361+0000","last_change":"2026-02-13T03:45:24.351804+0000","last_active":"2026-02-13T03:45:26.186361+0000","last_peered":"2026-02-13T03:45:26.186361+0000","last_clean":"2026-02-13T03:45:26.186361+0000","last_became_active":"2026-02-13T03:45:24.351594+0000","last_became_peered":"2026-02-13T03:45:24.351594+0000","last_unstale":"2026-02-13T03:45:26.186361+0000","last_undegraded":"2026-02-13T03:45:26.186361+0000","last_fullsized":"2026-02-13T03:45:26.186361+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:26:57.857287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347214+0000","last_change":"2026-02-13T03:45:23.350776+0000","last_active":"2026-02-13T03:45:25.347214+0000","last_peered":"2026-02-13T03:45:25.347214+0000","last_clean":"2026-02-13T03:45:25.347214+0000","last_became_active":"2026-02-13T03:45:23.350640+0000","last_became_peered":"2026-02-13T03:45:23.350640+0000","last_unstale":"2026-02-13T03:45:25.347214+0000","last_undegraded":"2026-02-13T03:45:25.347214+0000","last_fullsized":"2026-02-13T03:45:25.347214+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:52:28.690330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850321+0000","last_change":"2026-02-13T03:45:24.353462+0000","last_active":"2026-02-13T03:45:25.850321+0000","last_peered":"2026-02-13T03:45:25.850321+0000","last_clean":"2026-02-13T03:45:25.850321+0000","last_became_active":"2026-02-13T03:45:24.353125+0000","last_became_peered":"2026-02-13T03:45:24.353125+0000","last_unstale":"2026-02-13T03:45:25.850321+0000","last_undegraded":"2026-02-13T03:45:25.850321+0000","last_fullsized":"2026-02-13T03:45:25.850321+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:28:11.227093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348198+0000","last_change":"2026-02-13T03:45:23.354142+0000","last_active":"2026-02-13T03:45:25.348198+0000","last_peered":"2026-02-13T03:45:25.348198+0000","last_clean":"2026-02-13T03:45:25.348198+0000","last_became_active":"2026-02-13T03:45:23.353998+0000","last_became_peered":"2026-02-13T03:45:23.353998+0000","last_unstale":"2026-02-13T03:45:25.348198+0000","last_undegraded":"2026-02-13T03:45:25.348198+0000","last_fullsized":"2026-02-13T03:45:25.348198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:38:02.155173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.353375+0000","last_change":"2026-02-13T03:45:24.352663+0000","last_active":"2026-02-13T03:45:24.353375+0000","last_peered":"2026-02-13T03:45:24.353375+0000","last_clean":"2026-02-13T03:45:24.353375+0000","last_became_active":"2026-02-13T03:45:24.352121+0000","last_became_peered":"2026-02-13T03:45:24.352121+0000","last_unstale":"2026-02-13T03:45:24.353375+0000","last_undegraded":"2026-02-13T03:45:24.353375+0000","last_fullsized":"2026-02-13T03:45:24.353375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:12:46.500505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170156+0000","last_change":"2026-02-13T03:45:23.352681+0000","last_active":"2026-02-13T03:45:26.170156+0000","last_peered":"2026-02-13T03:45:26.170156+0000","last_clean":"2026-02-13T03:45:26.170156+0000","last_became_active":"2026-02-13T03:45:23.352549+0000","last_became_peered":"2026-02-13T03:45:23.352549+0000","last_unstale":"2026-02-13T03:45:26.170156+0000","last_undegraded":"2026-02-13T03:45:26.170156+0000","last_fullsized":"2026-02-13T03:45:26.170156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:19:36.419406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927843+0000","last_change":"2026-02-13T03:45:24.353993+0000","last_active":"2026-02-13T03:45:25.927843+0000","last_peered":"2026-02-13T03:45:25.927843+0000","last_clean":"2026-02-13T03:45:25.927843+0000","last_became_active":"2026-02-13T03:45:24.353849+0000","last_became_peered":"2026-02-13T03:45:24.353849+0000","last_unstale":"2026-02-13T03:45:25.927843+0000","last_undegraded":"2026-02-13T03:45:25.927843+0000","last_fullsized":"2026-02-13T03:45:25.927843+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:37:28.284522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850035+0000","last_change":"2026-02-13T03:45:23.350245+0000","last_active":"2026-02-13T03:45:25.850035+0000","last_peered":"2026-02-13T03:45:25.850035+0000","last_clean":"2026-02-13T03:45:25.850035+0000","last_became_active":"2026-02-13T03:45:23.349993+0000","last_became_peered":"2026-02-13T03:45:23.349993+0000","last_unstale":"2026-02-13T03:45:25.850035+0000","last_undegraded":"2026-02-13T03:45:25.850035+0000","last_fullsized":"2026-02-13T03:45:25.850035+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:26.787163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347702+0000","last_change":"2026-02-13T03:45:24.357857+0000","last_active":"2026-02-13T03:45:25.347702+0000","last_peered":"2026-02-13T03:45:25.347702+0000","last_clean":"2026-02-13T03:45:25.347702+0000","last_became_active":"2026-02-13T03:45:24.357686+0000","last_became_peered":"2026-02-13T03:45:24.357686+0000","last_unstale":"2026-02-13T03:45:25.347702+0000","last_undegraded":"2026-02-13T03:45:25.347702+0000","last_fullsized":"2026-02-13T03:45:25.347702+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:18:49.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.185913+0000","last_change":"2026-02-13T03:45:23.349986+0000","last_active":"2026-02-13T03:45:26.185913+0000","last_peered":"2026-02-13T03:45:26.185913+0000","last_clean":"2026-02-13T03:45:26.185913+0000","last_became_active":"2026-02-13T03:45:23.349724+0000","last_became_peered":"2026-02-13T03:45:23.349724+0000","last_unstale":"2026-02-13T03:45:26.185913+0000","last_undegraded":"2026-02-13T03:45:26.185913+0000","last_fullsized":"2026-02-13T03:45:26.185913+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:17:32.924039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850162+0000","last_change":"2026-02-13T03:45:24.354082+0000","last_active":"2026-02-13T03:45:25.850162+0000","last_peered":"2026-02-13T03:45:25.850162+0000","last_clean":"2026-02-13T03:45:25.850162+0000","last_became_active":"2026-02-13T03:45:24.353693+0000","last_became_peered":"2026-02-13T03:45:24.353693+0000","last_unstale":"2026-02-13T03:45:25.850162+0000","last_undegraded":"2026-02-13T03:45:25.850162+0000","last_fullsized":"2026-02-13T03:45:25.850162+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:56.149445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"69'2","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927928+0000","last_change":"2026-02-13T03:45:23.349449+0000","last_active":"2026-02-13T03:45:25.927928+0000","last_peered":"2026-02-13T03:45:25.927928+0000","last_clean":"2026-02-13T03:45:25.927928+0000","last_became_active":"2026-02-13T03:45:23.349088+0000","last_became_peered":"2026-02-13T03:45:23.349088+0000","last_unstale":"2026-02-13T03:45:25.927928+0000","last_undegraded":"2026-02-13T03:45:25.927928+0000","last_fullsized":"2026-02-13T03:45:25.927928+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:47:08.987853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421786+0000","last_change":"2026-02-13T03:45:24.353460+0000","last_active":"2026-02-13T03:45:25.421786+0000","last_peered":"2026-02-13T03:45:25.421786+0000","last_clean":"2026-02-13T03:45:25.421786+0000","last_became_active":"2026-02-13T03:45:24.353234+0000","last_became_peered":"2026-02-13T03:45:24.353234+0000","last_unstale":"2026-02-13T03:45:25.421786+0000","last_undegraded":"2026-02-13T03:45:25.421786+0000","last_fullsized":"2026-02-13T03:45:25.421786+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:37.604254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791188+0000","last_change":"2026-02-13T03:45:24.356273+0000","last_active":"2026-02-13T03:45:25.791188+0000","last_peered":"2026-02-13T03:45:25.791188+0000","last_clean":"2026-02-13T03:45:25.791188+0000","last_became_active":"2026-02-13T03:45:24.355811+0000","last_became_peered":"2026-02-13T03:45:24.355811+0000","last_unstale":"2026-02-13T03:45:25.791188+0000","last_undegraded":"2026-02-13T03:45:25.791188+0000","last_fullsized":"2026-02-13T03:45:25.791188+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:16:38.126683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928123+0000","last_change":"2026-02-13T03:45:23.348661+0000","last_active":"2026-02-13T03:45:25.928123+0000","last_peered":"2026-02-13T03:45:25.928123+0000","last_clean":"2026-02-13T03:45:25.928123+0000","last_became_active":"2026-02-13T03:45:23.348261+0000","last_became_peered":"2026-02-13T03:45:23.348261+0000","last_unstale":"2026-02-13T03:45:25.928123+0000","last_undegraded":"2026-02-13T03:45:25.928123+0000","last_fullsized":"2026-02-13T03:45:25.928123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:55.257025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170184+0000","last_change":"2026-02-13T03:45:24.354121+0000","last_active":"2026-02-13T03:45:26.170184+0000","last_peered":"2026-02-13T03:45:26.170184+0000","last_clean":"2026-02-13T03:45:26.170184+0000","last_became_active":"2026-02-13T03:45:24.354004+0000","last_became_peered":"2026-02-13T03:45:24.354004+0000","last_unstale":"2026-02-13T03:45:26.170184+0000","last_undegraded":"2026-02-13T03:45:26.170184+0000","last_fullsized":"2026-02-13T03:45:26.170184+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:23:50.879001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928021+0000","last_change":"2026-02-13T03:45:23.348978+0000","last_active":"2026-02-13T03:45:25.928021+0000","last_peered":"2026-02-13T03:45:25.928021+0000","last_clean":"2026-02-13T03:45:25.928021+0000","last_became_active":"2026-02-13T03:45:23.348824+0000","last_became_peered":"2026-02-13T03:45:23.348824+0000","last_unstale":"2026-02-13T03:45:25.928021+0000","last_undegraded":"2026-02-13T03:45:25.928021+0000","last_fullsized":"2026-02-13T03:45:25.928021+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:46:48.932535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.355048+0000","last_change":"2026-02-13T03:45:24.354516+0000","last_active":"2026-02-13T03:45:24.355048+0000","last_peered":"2026-02-13T03:45:24.355048+0000","last_clean":"2026-02-13T03:45:24.355048+0000","last_became_active":"2026-02-13T03:45:24.353042+0000","last_became_peered":"2026-02-13T03:45:24.353042+0000","last_unstale":"2026-02-13T03:45:24.355048+0000","last_undegraded":"2026-02-13T03:45:24.355048+0000","last_fullsized":"2026-02-13T03:45:24.355048+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:49:18.521398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850303+0000","last_change":"2026-02-13T03:45:23.353085+0000","last_active":"2026-02-13T03:45:25.850303+0000","last_peered":"2026-02-13T03:45:25.850303+0000","last_clean":"2026-02-13T03:45:25.850303+0000","last_became_active":"2026-02-13T03:45:23.352945+0000","last_became_peered":"2026-02-13T03:45:23.352945+0000","last_unstale":"2026-02-13T03:45:25.850303+0000","last_undegraded":"2026-02-13T03:45:25.850303+0000","last_fullsized":"2026-02-13T03:45:25.850303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:59.326051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850314+0000","last_change":"2026-02-13T03:45:24.356661+0000","last_active":"2026-02-13T03:45:25.850314+0000","last_peered":"2026-02-13T03:45:25.850314+0000","last_clean":"2026-02-13T03:45:25.850314+0000","last_became_active":"2026-02-13T03:45:24.356440+0000","last_became_peered":"2026-02-13T03:45:24.356440+0000","last_unstale":"2026-02-13T03:45:25.850314+0000","last_undegraded":"2026-02-13T03:45:25.850314+0000","last_fullsized":"2026-02-13T03:45:25.850314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:20.190644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"69'4","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347192+0000","last_change":"2026-02-13T03:45:23.349442+0000","last_active":"2026-02-13T03:45:25.347192+0000","last_peered":"2026-02-13T03:45:25.347192+0000","last_clean":"2026-02-13T03:45:25.347192+0000","last_became_active":"2026-02-13T03:45:23.349265+0000","last_became_peered":"2026-02-13T03:45:23.349265+0000","last_unstale":"2026-02-13T03:45:25.347192+0000","last_undegraded":"2026-02-13T03:45:25.347192+0000","last_fullsized":"2026-02-13T03:45:25.347192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:08:11.896196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":9205,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":38073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58719,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":299612,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874247,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":365060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8466,"internal_metadata":27582190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":58,"seq":249108103176,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":957256,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":18705,"internal_metadata":27571951},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928233993,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15636,"internal_metadata":27575020},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27712,"kb_used_data":748,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":733975488,"statfs":{"total":751619276800,"available":751590899712,"internally_reserved":0,"allocated":765952,"data_stored":365686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21090,"internal_metadata":27569566},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":40,"seq":171798691851,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":956032,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23850,"internal_metadata":27566806},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":36,"seq":154618822670,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":365060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19432,"internal_metadata":27571224},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":29,"seq":124554051599,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":955610,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":12636,"internal_metadata":27578020},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":26,"seq":111669149712,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30605,"internal_metadata":27560051},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378642,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27712,"kb_used_data":748,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975488,"statfs":{"total":751619276800,"available":751590899712,"internally_reserved":0,"allocated":765952,"data_stored":365164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32541,"internal_metadata":27558115},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27744,"kb_used_data":780,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975456,"statfs":{"total":751619276800,"available":751590866944,"internally_reserved":0,"allocated":798720,"data_stored":390688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49132,"internal_metadata":27541524},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672980,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27716,"kb_used_data":752,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975484,"statfs":{"total":751619276800,"available":751590895616,"internally_reserved":0,"allocated":770048,"data_stored":366694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40057,"internal_metadata":27550599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27680,"kb_used_data":716,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975520,"statfs":{"total":751619276800,"available":751590932480,"internally_reserved":0,"allocated":733184,"data_stored":347838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":27553226},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3725,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":25628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8260,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15976,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8820,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2208,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":778,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3371,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":8579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10968,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3420,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T03:45:31.169 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T03:45:31.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:30 trial177 ceph-mon[27082]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:31.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:30 trial177 ceph-mon[27082]: pgmap v189: 97 pgs: 97 active+clean; 586 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2026-02-13T03:45:31.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:30 trial177 ceph-mon[27082]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:31.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:30 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1756611494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:31.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:30 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3789015327' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:31.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:30 trial127 ceph-mon[26439]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:31.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:30 trial127 ceph-mon[26439]: pgmap v189: 97 pgs: 97 active+clean; 586 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 3.6 KiB/s wr, 8 op/s 2026-02-13T03:45:31.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:30 trial127 ceph-mon[26439]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:45:31.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:30 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1756611494' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T03:45:31.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:30 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3789015327' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:31.318 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:31.435 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 -- 10.20.193.70:0/819274059 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10fc20 msgr2=0x7fb4cc114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.435 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/819274059 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10fc20 0x7fb4cc114c60 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=9290685475065837234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4b40099a0 tx=0x7fb4b402ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 -- 10.20.193.70:0/819274059 shutdown_connections 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/819274059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb4cc115440 0x7fb4cc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/819274059 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10fc20 0x7fb4cc114c60 unknown :-1 s=CLOSED pgs=250 gs=1 cs=0 l=1 c_cookie=9290685475065837234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/819274059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4cc10f230 0x7fb4cc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 -- 10.20.193.70:0/819274059 >> 10.20.193.70:0/819274059 conn(0x7fb4cc0ecb30 msgr2=0x7fb4cc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 -- 10.20.193.70:0/819274059 shutdown_connections 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 -- 10.20.193.70:0/819274059 wait complete. 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 Processor -- start 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.431+0000 7fb4d17576c0 1 -- start start 2026-02-13T03:45:31.436 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4d17576c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10f230 0x7fb4cc0f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4d17576c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4cc115440 0x7fb4cc175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4d17576c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb4cc0f52c0 0x7fb4cc0fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4d17576c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc0f5920 con 0x7fb4cc10f230 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4d17576c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc0faa80 con 0x7fb4cc0f52c0 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4d17576c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc0fac40 con 0x7fb4cc115440 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4caffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10f230 0x7fb4cc0f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4caffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10f230 0x7fb4cc0f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33644/0 (socket says 10.20.193.70:33644) 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4caffd6c0 1 -- 10.20.193.70:0/3256186004 learned_addr learned my addr 10.20.193.70:0/3256186004 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4caffd6c0 1 -- 10.20.193.70:0/3256186004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4cc115440 msgr2=0x7fb4cc175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4ca7fc6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4cc115440 0x7fb4cc175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4cb7fe6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb4cc0f52c0 0x7fb4cc0fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4caffd6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4cc115440 0x7fb4cc175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4caffd6c0 1 -- 10.20.193.70:0/3256186004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb4cc0f52c0 msgr2=0x7fb4cc0fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4caffd6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb4cc0f52c0 0x7fb4cc0fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4caffd6c0 1 -- 10.20.193.70:0/3256186004 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b4009590 con 0x7fb4cc10f230 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4ca7fc6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4cc115440 0x7fb4cc175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4cb7fe6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb4cc0f52c0 0x7fb4cc0fa540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4caffd6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10f230 0x7fb4cc0f4c90 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4c0005dc0 tx=0x7fb4c000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4abfff6c0 1 -- 10.20.193.70:0/3256186004 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4c0004240 con 0x7fb4cc10f230 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc0faec0 con 0x7fb4cc10f230 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4abfff6c0 1 -- 10.20.193.70:0/3256186004 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb4c00043a0 con 0x7fb4cc10f230 2026-02-13T03:45:31.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4abfff6c0 1 -- 10.20.193.70:0/3256186004 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4c000ccd0 con 0x7fb4cc10f230 2026-02-13T03:45:31.439 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc0fb350 con 0x7fb4cc10f230 2026-02-13T03:45:31.439 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.432+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc110500 con 0x7fb4cc10f230 2026-02-13T03:45:31.440 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.434+0000 7fb4abfff6c0 1 -- 10.20.193.70:0/3256186004 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fb4c00026b0 con 0x7fb4cc10f230 2026-02-13T03:45:31.440 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.435+0000 7fb4abfff6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb4a00b5690 0x7fb4a00d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.440 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.435+0000 7fb4ca7fc6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb4a00b5690 0x7fb4a00d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.440 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.435+0000 7fb4abfff6c0 1 -- 10.20.193.70:0/3256186004 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fb4c00e3b50 con 0x7fb4cc10f230 2026-02-13T03:45:31.440 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.435+0000 7fb4abfff6c0 1 -- 10.20.193.70:0/3256186004 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb4c011c5e0 con 0x7fb4cc10f230 2026-02-13T03:45:31.440 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.435+0000 7fb4ca7fc6c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb4a00b5690 0x7fb4a00d5b40 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4cc0fb5d0 tx=0x7fb4b40023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:31.528 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.526+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4cc0f5dc0 con 0x7fb4a00b5690 2026-02-13T03:45:31.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.528+0000 7fb4abfff6c0 1 -- 10.20.193.70:0/3256186004 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258847 (secure 0 0 0) 0x7fb4cc0f5dc0 con 0x7fb4a00b5690 2026-02-13T03:45:31.532 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:31.534 INFO:teuthology.orchestra.run.trial070.stderr:dumped all 2026-02-13T03:45:31.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb4a00b5690 msgr2=0x7fb4a00d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb4a00b5690 0x7fb4a00d5b40 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4cc0fb5d0 tx=0x7fb4b40023a0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10f230 msgr2=0x7fb4cc0f4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10f230 0x7fb4cc0f4c90 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4c0005dc0 tx=0x7fb4c000bbb0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 shutdown_connections 2026-02-13T03:45:31.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb4a00b5690 0x7fb4a00d5b40 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb4cc0f52c0 0x7fb4cc0fa540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb4cc115440 0x7fb4cc175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 --2- 10.20.193.70:0/3256186004 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb4cc10f230 0x7fb4cc0f4c90 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 >> 10.20.193.70:0/3256186004 conn(0x7fb4cc0ecb30 msgr2=0x7fb4cc10d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:31.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 shutdown_connections 2026-02-13T03:45:31.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.530+0000 7fb4d17576c0 1 -- 10.20.193.70:0/3256186004 wait complete. 2026-02-13T03:45:31.573 INFO:teuthology.orchestra.run.trial070.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2026-02-13T03:45:29.781133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599573,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":99,"num_write":236,"num_write_kb":3739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":225,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":332684,"kb_used_data":9116,"kb_used_omap":302,"kb_used_meta":323025,"kb_avail":8807705716,"statfs":{"total":9019431321600,"available":9019090653184,"internally_reserved":0,"allocated":9334784,"data_stored":6165834,"data_compressed":114213,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":309580,"internal_metadata":330778292},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9205,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.437312"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347727+0000","last_change":"2026-02-13T03:45:24.355427+0000","last_active":"2026-02-13T03:45:25.347727+0000","last_peered":"2026-02-13T03:45:25.347727+0000","last_clean":"2026-02-13T03:45:25.347727+0000","last_became_active":"2026-02-13T03:45:24.354772+0000","last_became_peered":"2026-02-13T03:45:24.354772+0000","last_unstale":"2026-02-13T03:45:25.347727+0000","last_undegraded":"2026-02-13T03:45:25.347727+0000","last_fullsized":"2026-02-13T03:45:25.347727+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:09.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.354726+0000","last_change":"2026-02-13T03:45:24.354062+0000","last_active":"2026-02-13T03:45:24.354726+0000","last_peered":"2026-02-13T03:45:24.354726+0000","last_clean":"2026-02-13T03:45:24.354726+0000","last_became_active":"2026-02-13T03:45:24.353476+0000","last_became_peered":"2026-02-13T03:45:24.353476+0000","last_unstale":"2026-02-13T03:45:24.354726+0000","last_undegraded":"2026-02-13T03:45:24.354726+0000","last_fullsized":"2026-02-13T03:45:24.354726+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:35:46.107904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.354552+0000","last_change":"2026-02-13T03:45:24.353519+0000","last_active":"2026-02-13T03:45:24.354552+0000","last_peered":"2026-02-13T03:45:24.354552+0000","last_clean":"2026-02-13T03:45:24.354552+0000","last_became_active":"2026-02-13T03:45:24.352727+0000","last_became_peered":"2026-02-13T03:45:24.352727+0000","last_unstale":"2026-02-13T03:45:24.354552+0000","last_undegraded":"2026-02-13T03:45:24.354552+0000","last_fullsized":"2026-02-13T03:45:24.354552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:20.698348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348181+0000","last_change":"2026-02-13T03:45:24.353099+0000","last_active":"2026-02-13T03:45:25.348181+0000","last_peered":"2026-02-13T03:45:25.348181+0000","last_clean":"2026-02-13T03:45:25.348181+0000","last_became_active":"2026-02-13T03:45:24.352744+0000","last_became_peered":"2026-02-13T03:45:24.352744+0000","last_unstale":"2026-02-13T03:45:25.348181+0000","last_undegraded":"2026-02-13T03:45:25.348181+0000","last_fullsized":"2026-02-13T03:45:25.348181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:10:58.697391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927950+0000","last_change":"2026-02-13T03:45:24.352238+0000","last_active":"2026-02-13T03:45:25.927950+0000","last_peered":"2026-02-13T03:45:25.927950+0000","last_clean":"2026-02-13T03:45:25.927950+0000","last_became_active":"2026-02-13T03:45:24.352093+0000","last_became_peered":"2026-02-13T03:45:24.352093+0000","last_unstale":"2026-02-13T03:45:25.927950+0000","last_undegraded":"2026-02-13T03:45:25.927950+0000","last_fullsized":"2026-02-13T03:45:25.927950+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:40:14.634462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186270+0000","last_change":"2026-02-13T03:45:24.356372+0000","last_active":"2026-02-13T03:45:26.186270+0000","last_peered":"2026-02-13T03:45:26.186270+0000","last_clean":"2026-02-13T03:45:26.186270+0000","last_became_active":"2026-02-13T03:45:24.356087+0000","last_became_peered":"2026-02-13T03:45:24.356087+0000","last_unstale":"2026-02-13T03:45:26.186270+0000","last_undegraded":"2026-02-13T03:45:26.186270+0000","last_fullsized":"2026-02-13T03:45:26.186270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:35:30.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421404+0000","last_change":"2026-02-13T03:45:24.356259+0000","last_active":"2026-02-13T03:45:25.421404+0000","last_peered":"2026-02-13T03:45:25.421404+0000","last_clean":"2026-02-13T03:45:25.421404+0000","last_became_active":"2026-02-13T03:45:24.356054+0000","last_became_peered":"2026-02-13T03:45:24.356054+0000","last_unstale":"2026-02-13T03:45:25.421404+0000","last_undegraded":"2026-02-13T03:45:25.421404+0000","last_fullsized":"2026-02-13T03:45:25.421404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:41:54.530855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850055+0000","last_change":"2026-02-13T03:45:24.355402+0000","last_active":"2026-02-13T03:45:25.850055+0000","last_peered":"2026-02-13T03:45:25.850055+0000","last_clean":"2026-02-13T03:45:25.850055+0000","last_became_active":"2026-02-13T03:45:24.355240+0000","last_became_peered":"2026-02-13T03:45:24.355240+0000","last_unstale":"2026-02-13T03:45:25.850055+0000","last_undegraded":"2026-02-13T03:45:25.850055+0000","last_fullsized":"2026-02-13T03:45:25.850055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:41:11.797331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170279+0000","last_change":"2026-02-13T03:45:24.354542+0000","last_active":"2026-02-13T03:45:26.170279+0000","last_peered":"2026-02-13T03:45:26.170279+0000","last_clean":"2026-02-13T03:45:26.170279+0000","last_became_active":"2026-02-13T03:45:24.354387+0000","last_became_peered":"2026-02-13T03:45:24.354387+0000","last_unstale":"2026-02-13T03:45:26.170279+0000","last_undegraded":"2026-02-13T03:45:26.170279+0000","last_fullsized":"2026-02-13T03:45:26.170279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:45:32.036800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186512+0000","last_change":"2026-02-13T03:45:24.356533+0000","last_active":"2026-02-13T03:45:26.186512+0000","last_peered":"2026-02-13T03:45:26.186512+0000","last_clean":"2026-02-13T03:45:26.186512+0000","last_became_active":"2026-02-13T03:45:24.356262+0000","last_became_peered":"2026-02-13T03:45:24.356262+0000","last_unstale":"2026-02-13T03:45:26.186512+0000","last_undegraded":"2026-02-13T03:45:26.186512+0000","last_fullsized":"2026-02-13T03:45:26.186512+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:10:24.614545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421980+0000","last_change":"2026-02-13T03:45:24.354428+0000","last_active":"2026-02-13T03:45:25.421980+0000","last_peered":"2026-02-13T03:45:25.421980+0000","last_clean":"2026-02-13T03:45:25.421980+0000","last_became_active":"2026-02-13T03:45:24.354241+0000","last_became_peered":"2026-02-13T03:45:24.354241+0000","last_unstale":"2026-02-13T03:45:25.421980+0000","last_undegraded":"2026-02-13T03:45:25.421980+0000","last_fullsized":"2026-02-13T03:45:25.421980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:31.625314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348111+0000","last_change":"2026-02-13T03:45:24.353689+0000","last_active":"2026-02-13T03:45:25.348111+0000","last_peered":"2026-02-13T03:45:25.348111+0000","last_clean":"2026-02-13T03:45:25.348111+0000","last_became_active":"2026-02-13T03:45:24.353518+0000","last_became_peered":"2026-02-13T03:45:24.353518+0000","last_unstale":"2026-02-13T03:45:25.348111+0000","last_undegraded":"2026-02-13T03:45:25.348111+0000","last_fullsized":"2026-02-13T03:45:25.348111+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:20:01.588601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186445+0000","last_change":"2026-02-13T03:45:24.353765+0000","last_active":"2026-02-13T03:45:26.186445+0000","last_peered":"2026-02-13T03:45:26.186445+0000","last_clean":"2026-02-13T03:45:26.186445+0000","last_became_active":"2026-02-13T03:45:24.353522+0000","last_became_peered":"2026-02-13T03:45:24.353522+0000","last_unstale":"2026-02-13T03:45:26.186445+0000","last_undegraded":"2026-02-13T03:45:26.186445+0000","last_fullsized":"2026-02-13T03:45:26.186445+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:46:34.122311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.354679+0000","last_change":"2026-02-13T03:45:24.353969+0000","last_active":"2026-02-13T03:45:24.354679+0000","last_peered":"2026-02-13T03:45:24.354679+0000","last_clean":"2026-02-13T03:45:24.354679+0000","last_became_active":"2026-02-13T03:45:24.353461+0000","last_became_peered":"2026-02-13T03:45:24.353461+0000","last_unstale":"2026-02-13T03:45:24.354679+0000","last_undegraded":"2026-02-13T03:45:24.354679+0000","last_fullsized":"2026-02-13T03:45:24.354679+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:22.344391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.349983+0000","last_change":"2026-02-13T03:45:24.349803+0000","last_active":"2026-02-13T03:45:24.349983+0000","last_peered":"2026-02-13T03:45:24.349983+0000","last_clean":"2026-02-13T03:45:24.349983+0000","last_became_active":"2026-02-13T03:45:24.349591+0000","last_became_peered":"2026-02-13T03:45:24.349591+0000","last_unstale":"2026-02-13T03:45:24.349983+0000","last_undegraded":"2026-02-13T03:45:24.349983+0000","last_fullsized":"2026-02-13T03:45:24.349983+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:30:43.396676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170120+0000","last_change":"2026-02-13T03:45:24.353411+0000","last_active":"2026-02-13T03:45:26.170120+0000","last_peered":"2026-02-13T03:45:26.170120+0000","last_clean":"2026-02-13T03:45:26.170120+0000","last_became_active":"2026-02-13T03:45:24.353278+0000","last_became_peered":"2026-02-13T03:45:24.353278+0000","last_unstale":"2026-02-13T03:45:26.170120+0000","last_undegraded":"2026-02-13T03:45:26.170120+0000","last_fullsized":"2026-02-13T03:45:26.170120+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:49.049280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347746+0000","last_change":"2026-02-13T03:45:24.355567+0000","last_active":"2026-02-13T03:45:25.347746+0000","last_peered":"2026-02-13T03:45:25.347746+0000","last_clean":"2026-02-13T03:45:25.347746+0000","last_became_active":"2026-02-13T03:45:24.354971+0000","last_became_peered":"2026-02-13T03:45:24.354971+0000","last_unstale":"2026-02-13T03:45:25.347746+0000","last_undegraded":"2026-02-13T03:45:25.347746+0000","last_fullsized":"2026-02-13T03:45:25.347746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:35:23.426524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347236+0000","last_change":"2026-02-13T03:45:24.355317+0000","last_active":"2026-02-13T03:45:25.347236+0000","last_peered":"2026-02-13T03:45:25.347236+0000","last_clean":"2026-02-13T03:45:25.347236+0000","last_became_active":"2026-02-13T03:45:24.355131+0000","last_became_peered":"2026-02-13T03:45:24.355131+0000","last_unstale":"2026-02-13T03:45:25.347236+0000","last_undegraded":"2026-02-13T03:45:25.347236+0000","last_fullsized":"2026-02-13T03:45:25.347236+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:02.617097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186145+0000","last_change":"2026-02-13T03:45:24.354455+0000","last_active":"2026-02-13T03:45:26.186145+0000","last_peered":"2026-02-13T03:45:26.186145+0000","last_clean":"2026-02-13T03:45:26.186145+0000","last_became_active":"2026-02-13T03:45:24.353604+0000","last_became_peered":"2026-02-13T03:45:24.353604+0000","last_unstale":"2026-02-13T03:45:26.186145+0000","last_undegraded":"2026-02-13T03:45:26.186145+0000","last_fullsized":"2026-02-13T03:45:26.186145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:48:18.147862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347614+0000","last_change":"2026-02-13T03:45:24.353184+0000","last_active":"2026-02-13T03:45:25.347614+0000","last_peered":"2026-02-13T03:45:25.347614+0000","last_clean":"2026-02-13T03:45:25.347614+0000","last_became_active":"2026-02-13T03:45:24.352982+0000","last_became_peered":"2026-02-13T03:45:24.352982+0000","last_unstale":"2026-02-13T03:45:25.347614+0000","last_undegraded":"2026-02-13T03:45:25.347614+0000","last_fullsized":"2026-02-13T03:45:25.347614+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:42.997383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186389+0000","last_change":"2026-02-13T03:45:24.353667+0000","last_active":"2026-02-13T03:45:26.186389+0000","last_peered":"2026-02-13T03:45:26.186389+0000","last_clean":"2026-02-13T03:45:26.186389+0000","last_became_active":"2026-02-13T03:45:24.353361+0000","last_became_peered":"2026-02-13T03:45:24.353361+0000","last_unstale":"2026-02-13T03:45:26.186389+0000","last_undegraded":"2026-02-13T03:45:26.186389+0000","last_fullsized":"2026-02-13T03:45:26.186389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:56:51.287334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170246+0000","last_change":"2026-02-13T03:45:24.354416+0000","last_active":"2026-02-13T03:45:26.170246+0000","last_peered":"2026-02-13T03:45:26.170246+0000","last_clean":"2026-02-13T03:45:26.170246+0000","last_became_active":"2026-02-13T03:45:24.354207+0000","last_became_peered":"2026-02-13T03:45:24.354207+0000","last_unstale":"2026-02-13T03:45:26.170246+0000","last_undegraded":"2026-02-13T03:45:26.170246+0000","last_fullsized":"2026-02-13T03:45:26.170246+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:06:10.307319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850064+0000","last_change":"2026-02-13T03:45:24.354597+0000","last_active":"2026-02-13T03:45:25.850064+0000","last_peered":"2026-02-13T03:45:25.850064+0000","last_clean":"2026-02-13T03:45:25.850064+0000","last_became_active":"2026-02-13T03:45:24.354310+0000","last_became_peered":"2026-02-13T03:45:24.354310+0000","last_unstale":"2026-02-13T03:45:25.850064+0000","last_undegraded":"2026-02-13T03:45:25.850064+0000","last_fullsized":"2026-02-13T03:45:25.850064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:55.801674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791080+0000","last_change":"2026-02-13T03:45:24.355114+0000","last_active":"2026-02-13T03:45:25.791080+0000","last_peered":"2026-02-13T03:45:25.791080+0000","last_clean":"2026-02-13T03:45:25.791080+0000","last_became_active":"2026-02-13T03:45:24.353783+0000","last_became_peered":"2026-02-13T03:45:24.353783+0000","last_unstale":"2026-02-13T03:45:25.791080+0000","last_undegraded":"2026-02-13T03:45:25.791080+0000","last_fullsized":"2026-02-13T03:45:25.791080+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:42.747894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850333+0000","last_change":"2026-02-13T03:45:24.356301+0000","last_active":"2026-02-13T03:45:25.850333+0000","last_peered":"2026-02-13T03:45:25.850333+0000","last_clean":"2026-02-13T03:45:25.850333+0000","last_became_active":"2026-02-13T03:45:24.356101+0000","last_became_peered":"2026-02-13T03:45:24.356101+0000","last_unstale":"2026-02-13T03:45:25.850333+0000","last_undegraded":"2026-02-13T03:45:25.850333+0000","last_fullsized":"2026-02-13T03:45:25.850333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:02:39.812365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186262+0000","last_change":"2026-02-13T03:45:24.354631+0000","last_active":"2026-02-13T03:45:26.186262+0000","last_peered":"2026-02-13T03:45:26.186262+0000","last_clean":"2026-02-13T03:45:26.186262+0000","last_became_active":"2026-02-13T03:45:24.354306+0000","last_became_peered":"2026-02-13T03:45:24.354306+0000","last_unstale":"2026-02-13T03:45:26.186262+0000","last_undegraded":"2026-02-13T03:45:26.186262+0000","last_fullsized":"2026-02-13T03:45:26.186262+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:57.612589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347635+0000","last_change":"2026-02-13T03:45:24.354688+0000","last_active":"2026-02-13T03:45:25.347635+0000","last_peered":"2026-02-13T03:45:25.347635+0000","last_clean":"2026-02-13T03:45:25.347635+0000","last_became_active":"2026-02-13T03:45:24.354555+0000","last_became_peered":"2026-02-13T03:45:24.354555+0000","last_unstale":"2026-02-13T03:45:25.347635+0000","last_undegraded":"2026-02-13T03:45:25.347635+0000","last_fullsized":"2026-02-13T03:45:25.347635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:25.329082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186328+0000","last_change":"2026-02-13T03:45:24.349557+0000","last_active":"2026-02-13T03:45:26.186328+0000","last_peered":"2026-02-13T03:45:26.186328+0000","last_clean":"2026-02-13T03:45:26.186328+0000","last_became_active":"2026-02-13T03:45:24.349043+0000","last_became_peered":"2026-02-13T03:45:24.349043+0000","last_unstale":"2026-02-13T03:45:26.186328+0000","last_undegraded":"2026-02-13T03:45:26.186328+0000","last_fullsized":"2026-02-13T03:45:26.186328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:43.058296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.349914+0000","last_change":"2026-02-13T03:45:24.349552+0000","last_active":"2026-02-13T03:45:24.349914+0000","last_peered":"2026-02-13T03:45:24.349914+0000","last_clean":"2026-02-13T03:45:24.349914+0000","last_became_active":"2026-02-13T03:45:24.349020+0000","last_became_peered":"2026-02-13T03:45:24.349020+0000","last_unstale":"2026-02-13T03:45:24.349914+0000","last_undegraded":"2026-02-13T03:45:24.349914+0000","last_fullsized":"2026-02-13T03:45:24.349914+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:12.323059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.185956+0000","last_change":"2026-02-13T03:45:24.354554+0000","last_active":"2026-02-13T03:45:26.185956+0000","last_peered":"2026-02-13T03:45:26.185956+0000","last_clean":"2026-02-13T03:45:26.185956+0000","last_became_active":"2026-02-13T03:45:24.353925+0000","last_became_peered":"2026-02-13T03:45:24.353925+0000","last_unstale":"2026-02-13T03:45:26.185956+0000","last_undegraded":"2026-02-13T03:45:26.185956+0000","last_fullsized":"2026-02-13T03:45:26.185956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:30:45.125643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186026+0000","last_change":"2026-02-13T03:45:24.355744+0000","last_active":"2026-02-13T03:45:26.186026+0000","last_peered":"2026-02-13T03:45:26.186026+0000","last_clean":"2026-02-13T03:45:26.186026+0000","last_became_active":"2026-02-13T03:45:24.355532+0000","last_became_peered":"2026-02-13T03:45:24.355532+0000","last_unstale":"2026-02-13T03:45:26.186026+0000","last_undegraded":"2026-02-13T03:45:26.186026+0000","last_fullsized":"2026-02-13T03:45:26.186026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:35:14.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347444+0000","last_change":"2026-02-13T03:45:24.355681+0000","last_active":"2026-02-13T03:45:25.347444+0000","last_peered":"2026-02-13T03:45:25.347444+0000","last_clean":"2026-02-13T03:45:25.347444+0000","last_became_active":"2026-02-13T03:45:24.355539+0000","last_became_peered":"2026-02-13T03:45:24.355539+0000","last_unstale":"2026-02-13T03:45:25.347444+0000","last_undegraded":"2026-02-13T03:45:25.347444+0000","last_fullsized":"2026-02-13T03:45:25.347444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:14:16.800666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927954+0000","last_change":"2026-02-13T03:45:24.353034+0000","last_active":"2026-02-13T03:45:25.927954+0000","last_peered":"2026-02-13T03:45:25.927954+0000","last_clean":"2026-02-13T03:45:25.927954+0000","last_became_active":"2026-02-13T03:45:24.352925+0000","last_became_peered":"2026-02-13T03:45:24.352925+0000","last_unstale":"2026-02-13T03:45:25.927954+0000","last_undegraded":"2026-02-13T03:45:25.927954+0000","last_fullsized":"2026-02-13T03:45:25.927954+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:29:42.354130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791049+0000","last_change":"2026-02-13T03:45:23.349400+0000","last_active":"2026-02-13T03:45:25.791049+0000","last_peered":"2026-02-13T03:45:25.791049+0000","last_clean":"2026-02-13T03:45:25.791049+0000","last_became_active":"2026-02-13T03:45:23.349283+0000","last_became_peered":"2026-02-13T03:45:23.349283+0000","last_unstale":"2026-02-13T03:45:25.791049+0000","last_undegraded":"2026-02-13T03:45:25.791049+0000","last_fullsized":"2026-02-13T03:45:25.791049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:43:46.907002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791094+0000","last_change":"2026-02-13T03:45:24.354044+0000","last_active":"2026-02-13T03:45:25.791094+0000","last_peered":"2026-02-13T03:45:25.791094+0000","last_clean":"2026-02-13T03:45:25.791094+0000","last_became_active":"2026-02-13T03:45:24.353314+0000","last_became_peered":"2026-02-13T03:45:24.353314+0000","last_unstale":"2026-02-13T03:45:25.791094+0000","last_undegraded":"2026-02-13T03:45:25.791094+0000","last_fullsized":"2026-02-13T03:45:25.791094+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:21:37.422406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186240+0000","last_change":"2026-02-13T03:45:23.349077+0000","last_active":"2026-02-13T03:45:26.186240+0000","last_peered":"2026-02-13T03:45:26.186240+0000","last_clean":"2026-02-13T03:45:26.186240+0000","last_became_active":"2026-02-13T03:45:23.348867+0000","last_became_peered":"2026-02-13T03:45:23.348867+0000","last_unstale":"2026-02-13T03:45:26.186240+0000","last_undegraded":"2026-02-13T03:45:26.186240+0000","last_fullsized":"2026-02-13T03:45:26.186240+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:47:13.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186082+0000","last_change":"2026-02-13T03:45:23.350107+0000","last_active":"2026-02-13T03:45:26.186082+0000","last_peered":"2026-02-13T03:45:26.186082+0000","last_clean":"2026-02-13T03:45:26.186082+0000","last_became_active":"2026-02-13T03:45:23.349864+0000","last_became_peered":"2026-02-13T03:45:23.349864+0000","last_unstale":"2026-02-13T03:45:26.186082+0000","last_undegraded":"2026-02-13T03:45:26.186082+0000","last_fullsized":"2026-02-13T03:45:26.186082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:12:31.503069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850113+0000","last_change":"2026-02-13T03:45:24.353268+0000","last_active":"2026-02-13T03:45:25.850113+0000","last_peered":"2026-02-13T03:45:25.850113+0000","last_clean":"2026-02-13T03:45:25.850113+0000","last_became_active":"2026-02-13T03:45:24.352994+0000","last_became_peered":"2026-02-13T03:45:24.352994+0000","last_unstale":"2026-02-13T03:45:25.850113+0000","last_undegraded":"2026-02-13T03:45:25.850113+0000","last_fullsized":"2026-02-13T03:45:25.850113+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:34.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791178+0000","last_change":"2026-02-13T03:45:23.348540+0000","last_active":"2026-02-13T03:45:25.791178+0000","last_peered":"2026-02-13T03:45:25.791178+0000","last_clean":"2026-02-13T03:45:25.791178+0000","last_became_active":"2026-02-13T03:45:23.348169+0000","last_became_peered":"2026-02-13T03:45:23.348169+0000","last_unstale":"2026-02-13T03:45:25.791178+0000","last_undegraded":"2026-02-13T03:45:25.791178+0000","last_fullsized":"2026-02-13T03:45:25.791178+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:41:37.655572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347232+0000","last_change":"2026-02-13T03:45:24.354464+0000","last_active":"2026-02-13T03:45:25.347232+0000","last_peered":"2026-02-13T03:45:25.347232+0000","last_clean":"2026-02-13T03:45:25.347232+0000","last_became_active":"2026-02-13T03:45:24.354209+0000","last_became_peered":"2026-02-13T03:45:24.354209+0000","last_unstale":"2026-02-13T03:45:25.347232+0000","last_undegraded":"2026-02-13T03:45:25.347232+0000","last_fullsized":"2026-02-13T03:45:25.347232+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:45:06.054136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186496+0000","last_change":"2026-02-13T03:45:23.349686+0000","last_active":"2026-02-13T03:45:26.186496+0000","last_peered":"2026-02-13T03:45:26.186496+0000","last_clean":"2026-02-13T03:45:26.186496+0000","last_became_active":"2026-02-13T03:45:23.349198+0000","last_became_peered":"2026-02-13T03:45:23.349198+0000","last_unstale":"2026-02-13T03:45:26.186496+0000","last_undegraded":"2026-02-13T03:45:26.186496+0000","last_fullsized":"2026-02-13T03:45:26.186496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:57:46.527371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170290+0000","last_change":"2026-02-13T03:45:24.355581+0000","last_active":"2026-02-13T03:45:26.170290+0000","last_peered":"2026-02-13T03:45:26.170290+0000","last_clean":"2026-02-13T03:45:26.170290+0000","last_became_active":"2026-02-13T03:45:24.355429+0000","last_became_peered":"2026-02-13T03:45:24.355429+0000","last_unstale":"2026-02-13T03:45:26.170290+0000","last_undegraded":"2026-02-13T03:45:26.170290+0000","last_fullsized":"2026-02-13T03:45:26.170290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:49:00.947016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421822+0000","last_change":"2026-02-13T03:45:23.350353+0000","last_active":"2026-02-13T03:45:25.421822+0000","last_peered":"2026-02-13T03:45:25.421822+0000","last_clean":"2026-02-13T03:45:25.421822+0000","last_became_active":"2026-02-13T03:45:23.349728+0000","last_became_peered":"2026-02-13T03:45:23.349728+0000","last_unstale":"2026-02-13T03:45:25.421822+0000","last_undegraded":"2026-02-13T03:45:25.421822+0000","last_fullsized":"2026-02-13T03:45:25.421822+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:21:58.252825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.355286+0000","last_change":"2026-02-13T03:45:24.355069+0000","last_active":"2026-02-13T03:45:24.355286+0000","last_peered":"2026-02-13T03:45:24.355286+0000","last_clean":"2026-02-13T03:45:24.355286+0000","last_became_active":"2026-02-13T03:45:24.354927+0000","last_became_peered":"2026-02-13T03:45:24.354927+0000","last_unstale":"2026-02-13T03:45:24.355286+0000","last_undegraded":"2026-02-13T03:45:24.355286+0000","last_fullsized":"2026-02-13T03:45:24.355286+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:54:58.099532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"69'3","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791069+0000","last_change":"2026-02-13T03:45:23.352479+0000","last_active":"2026-02-13T03:45:25.791069+0000","last_peered":"2026-02-13T03:45:25.791069+0000","last_clean":"2026-02-13T03:45:25.791069+0000","last_became_active":"2026-02-13T03:45:23.352227+0000","last_became_peered":"2026-02-13T03:45:23.352227+0000","last_unstale":"2026-02-13T03:45:25.791069+0000","last_undegraded":"2026-02-13T03:45:25.791069+0000","last_fullsized":"2026-02-13T03:45:25.791069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:24:25.395518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170237+0000","last_change":"2026-02-13T03:45:24.353602+0000","last_active":"2026-02-13T03:45:26.170237+0000","last_peered":"2026-02-13T03:45:26.170237+0000","last_clean":"2026-02-13T03:45:26.170237+0000","last_became_active":"2026-02-13T03:45:24.352872+0000","last_became_peered":"2026-02-13T03:45:24.352872+0000","last_unstale":"2026-02-13T03:45:26.170237+0000","last_undegraded":"2026-02-13T03:45:26.170237+0000","last_fullsized":"2026-02-13T03:45:26.170237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:38.831095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"70'9","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:28.327680+0000","last_change":"2026-02-13T03:45:23.349666+0000","last_active":"2026-02-13T03:45:28.327680+0000","last_peered":"2026-02-13T03:45:28.327680+0000","last_clean":"2026-02-13T03:45:28.327680+0000","last_became_active":"2026-02-13T03:45:23.349482+0000","last_became_peered":"2026-02-13T03:45:23.349482+0000","last_unstale":"2026-02-13T03:45:28.327680+0000","last_undegraded":"2026-02-13T03:45:28.327680+0000","last_fullsized":"2026-02-13T03:45:28.327680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:36.983368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928003+0000","last_change":"2026-02-13T03:45:24.352564+0000","last_active":"2026-02-13T03:45:25.928003+0000","last_peered":"2026-02-13T03:45:25.928003+0000","last_clean":"2026-02-13T03:45:25.928003+0000","last_became_active":"2026-02-13T03:45:24.352442+0000","last_became_peered":"2026-02-13T03:45:24.352442+0000","last_unstale":"2026-02-13T03:45:25.928003+0000","last_undegraded":"2026-02-13T03:45:25.928003+0000","last_fullsized":"2026-02-13T03:45:25.928003+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:40:35.470403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"69'2","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186086+0000","last_change":"2026-02-13T03:45:23.349943+0000","last_active":"2026-02-13T03:45:26.186086+0000","last_peered":"2026-02-13T03:45:26.186086+0000","last_clean":"2026-02-13T03:45:26.186086+0000","last_became_active":"2026-02-13T03:45:23.349747+0000","last_became_peered":"2026-02-13T03:45:23.349747+0000","last_unstale":"2026-02-13T03:45:26.186086+0000","last_undegraded":"2026-02-13T03:45:26.186086+0000","last_fullsized":"2026-02-13T03:45:26.186086+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:46:29.724224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186270+0000","last_change":"2026-02-13T03:45:24.353731+0000","last_active":"2026-02-13T03:45:26.186270+0000","last_peered":"2026-02-13T03:45:26.186270+0000","last_clean":"2026-02-13T03:45:26.186270+0000","last_became_active":"2026-02-13T03:45:24.353367+0000","last_became_peered":"2026-02-13T03:45:24.353367+0000","last_unstale":"2026-02-13T03:45:26.186270+0000","last_undegraded":"2026-02-13T03:45:26.186270+0000","last_fullsized":"2026-02-13T03:45:26.186270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:23:13.530630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.790926+0000","last_change":"2026-02-13T03:45:23.348565+0000","last_active":"2026-02-13T03:45:25.790926+0000","last_peered":"2026-02-13T03:45:25.790926+0000","last_clean":"2026-02-13T03:45:25.790926+0000","last_became_active":"2026-02-13T03:45:23.348280+0000","last_became_peered":"2026-02-13T03:45:23.348280+0000","last_unstale":"2026-02-13T03:45:25.790926+0000","last_undegraded":"2026-02-13T03:45:25.790926+0000","last_fullsized":"2026-02-13T03:45:25.790926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:55:08.236742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421805+0000","last_change":"2026-02-13T03:45:24.353067+0000","last_active":"2026-02-13T03:45:25.421805+0000","last_peered":"2026-02-13T03:45:25.421805+0000","last_clean":"2026-02-13T03:45:25.421805+0000","last_became_active":"2026-02-13T03:45:24.352535+0000","last_became_peered":"2026-02-13T03:45:24.352535+0000","last_unstale":"2026-02-13T03:45:25.421805+0000","last_undegraded":"2026-02-13T03:45:25.421805+0000","last_fullsized":"2026-02-13T03:45:25.421805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:19.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347856+0000","last_change":"2026-02-13T03:45:23.349989+0000","last_active":"2026-02-13T03:45:25.347856+0000","last_peered":"2026-02-13T03:45:25.347856+0000","last_clean":"2026-02-13T03:45:25.347856+0000","last_became_active":"2026-02-13T03:45:23.349774+0000","last_became_peered":"2026-02-13T03:45:23.349774+0000","last_unstale":"2026-02-13T03:45:25.347856+0000","last_undegraded":"2026-02-13T03:45:25.347856+0000","last_fullsized":"2026-02-13T03:45:25.347856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:10.402322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421339+0000","last_change":"2026-02-13T03:45:24.356431+0000","last_active":"2026-02-13T03:45:25.421339+0000","last_peered":"2026-02-13T03:45:25.421339+0000","last_clean":"2026-02-13T03:45:25.421339+0000","last_became_active":"2026-02-13T03:45:24.355854+0000","last_became_peered":"2026-02-13T03:45:24.355854+0000","last_unstale":"2026-02-13T03:45:25.421339+0000","last_undegraded":"2026-02-13T03:45:25.421339+0000","last_fullsized":"2026-02-13T03:45:25.421339+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:23:56.021478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"69'8","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927749+0000","last_change":"2026-02-13T03:45:23.352300+0000","last_active":"2026-02-13T03:45:25.927749+0000","last_peered":"2026-02-13T03:45:25.927749+0000","last_clean":"2026-02-13T03:45:25.927749+0000","last_became_active":"2026-02-13T03:45:23.352176+0000","last_became_peered":"2026-02-13T03:45:23.352176+0000","last_unstale":"2026-02-13T03:45:25.927749+0000","last_undegraded":"2026-02-13T03:45:25.927749+0000","last_fullsized":"2026-02-13T03:45:25.927749+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:56.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791150+0000","last_change":"2026-02-13T03:45:24.355963+0000","last_active":"2026-02-13T03:45:25.791150+0000","last_peered":"2026-02-13T03:45:25.791150+0000","last_clean":"2026-02-13T03:45:25.791150+0000","last_became_active":"2026-02-13T03:45:24.354819+0000","last_became_peered":"2026-02-13T03:45:24.354819+0000","last_unstale":"2026-02-13T03:45:25.791150+0000","last_undegraded":"2026-02-13T03:45:25.791150+0000","last_fullsized":"2026-02-13T03:45:25.791150+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:23:36.255505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"69'1","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928091+0000","last_change":"2026-02-13T03:45:23.346399+0000","last_active":"2026-02-13T03:45:25.928091+0000","last_peered":"2026-02-13T03:45:25.928091+0000","last_clean":"2026-02-13T03:45:25.928091+0000","last_became_active":"2026-02-13T03:45:23.346195+0000","last_became_peered":"2026-02-13T03:45:23.346195+0000","last_unstale":"2026-02-13T03:45:25.928091+0000","last_undegraded":"2026-02-13T03:45:25.928091+0000","last_fullsized":"2026-02-13T03:45:25.928091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:40:17.923580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347701+0000","last_change":"2026-02-13T03:45:24.355093+0000","last_active":"2026-02-13T03:45:25.347701+0000","last_peered":"2026-02-13T03:45:25.347701+0000","last_clean":"2026-02-13T03:45:25.347701+0000","last_became_active":"2026-02-13T03:45:24.354967+0000","last_became_peered":"2026-02-13T03:45:24.354967+0000","last_unstale":"2026-02-13T03:45:25.347701+0000","last_undegraded":"2026-02-13T03:45:25.347701+0000","last_fullsized":"2026-02-13T03:45:25.347701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:47.555133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186318+0000","last_change":"2026-02-13T03:45:23.350209+0000","last_active":"2026-02-13T03:45:26.186318+0000","last_peered":"2026-02-13T03:45:26.186318+0000","last_clean":"2026-02-13T03:45:26.186318+0000","last_became_active":"2026-02-13T03:45:23.349865+0000","last_became_peered":"2026-02-13T03:45:23.349865+0000","last_unstale":"2026-02-13T03:45:26.186318+0000","last_undegraded":"2026-02-13T03:45:26.186318+0000","last_fullsized":"2026-02-13T03:45:26.186318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:31:13.959587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.422025+0000","last_change":"2026-02-13T03:45:24.353947+0000","last_active":"2026-02-13T03:45:25.422025+0000","last_peered":"2026-02-13T03:45:25.422025+0000","last_clean":"2026-02-13T03:45:25.422025+0000","last_became_active":"2026-02-13T03:45:24.353550+0000","last_became_peered":"2026-02-13T03:45:24.353550+0000","last_unstale":"2026-02-13T03:45:25.422025+0000","last_undegraded":"2026-02-13T03:45:25.422025+0000","last_fullsized":"2026-02-13T03:45:25.422025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:39.579793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791199+0000","last_change":"2026-02-13T03:45:23.347676+0000","last_active":"2026-02-13T03:45:25.791199+0000","last_peered":"2026-02-13T03:45:25.791199+0000","last_clean":"2026-02-13T03:45:25.791199+0000","last_became_active":"2026-02-13T03:45:23.347440+0000","last_became_peered":"2026-02-13T03:45:23.347440+0000","last_unstale":"2026-02-13T03:45:25.791199+0000","last_undegraded":"2026-02-13T03:45:25.791199+0000","last_fullsized":"2026-02-13T03:45:25.791199+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:57:40.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421808+0000","last_change":"2026-02-13T03:45:24.356079+0000","last_active":"2026-02-13T03:45:25.421808+0000","last_peered":"2026-02-13T03:45:25.421808+0000","last_clean":"2026-02-13T03:45:25.421808+0000","last_became_active":"2026-02-13T03:45:24.355776+0000","last_became_peered":"2026-02-13T03:45:24.355776+0000","last_unstale":"2026-02-13T03:45:25.421808+0000","last_undegraded":"2026-02-13T03:45:25.421808+0000","last_fullsized":"2026-02-13T03:45:25.421808+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:06.447768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186148+0000","last_change":"2026-02-13T03:45:23.352633+0000","last_active":"2026-02-13T03:45:26.186148+0000","last_peered":"2026-02-13T03:45:26.186148+0000","last_clean":"2026-02-13T03:45:26.186148+0000","last_became_active":"2026-02-13T03:45:23.352460+0000","last_became_peered":"2026-02-13T03:45:23.352460+0000","last_unstale":"2026-02-13T03:45:26.186148+0000","last_undegraded":"2026-02-13T03:45:26.186148+0000","last_fullsized":"2026-02-13T03:45:26.186148+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:59.397129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.422048+0000","last_change":"2026-02-13T03:45:24.353603+0000","last_active":"2026-02-13T03:45:25.422048+0000","last_peered":"2026-02-13T03:45:25.422048+0000","last_clean":"2026-02-13T03:45:25.422048+0000","last_became_active":"2026-02-13T03:45:24.353292+0000","last_became_peered":"2026-02-13T03:45:24.353292+0000","last_unstale":"2026-02-13T03:45:25.422048+0000","last_undegraded":"2026-02-13T03:45:25.422048+0000","last_fullsized":"2026-02-13T03:45:25.422048+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:04:30.019967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'152","reported_seq":336,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421413+0000","last_change":"2026-02-13T03:45:01.868042+0000","last_active":"2026-02-13T03:45:25.421413+0000","last_peered":"2026-02-13T03:45:25.421413+0000","last_clean":"2026-02-13T03:45:25.421413+0000","last_became_active":"2026-02-13T03:45:01.867747+0000","last_became_peered":"2026-02-13T03:45:01.867747+0000","last_unstale":"2026-02-13T03:45:25.421413+0000","last_undegraded":"2026-02-13T03:45:25.421413+0000","last_fullsized":"2026-02-13T03:45:25.421413+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:43:59.641267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:43:59.641267+0000","last_clean_scrub_stamp":"2026-02-13T03:43:59.641267+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:48:43.238019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347838+0000","last_change":"2026-02-13T03:45:23.349113+0000","last_active":"2026-02-13T03:45:25.347838+0000","last_peered":"2026-02-13T03:45:25.347838+0000","last_clean":"2026-02-13T03:45:25.347838+0000","last_became_active":"2026-02-13T03:45:23.348948+0000","last_became_peered":"2026-02-13T03:45:23.348948+0000","last_unstale":"2026-02-13T03:45:25.347838+0000","last_undegraded":"2026-02-13T03:45:25.347838+0000","last_fullsized":"2026-02-13T03:45:25.347838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:00:41.357000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850169+0000","last_change":"2026-02-13T03:45:24.354838+0000","last_active":"2026-02-13T03:45:25.850169+0000","last_peered":"2026-02-13T03:45:25.850169+0000","last_clean":"2026-02-13T03:45:25.850169+0000","last_became_active":"2026-02-13T03:45:24.354639+0000","last_became_peered":"2026-02-13T03:45:24.354639+0000","last_unstale":"2026-02-13T03:45:25.850169+0000","last_undegraded":"2026-02-13T03:45:25.850169+0000","last_fullsized":"2026-02-13T03:45:25.850169+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:22.121456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421381+0000","last_change":"2026-02-13T03:45:23.349837+0000","last_active":"2026-02-13T03:45:25.421381+0000","last_peered":"2026-02-13T03:45:25.421381+0000","last_clean":"2026-02-13T03:45:25.421381+0000","last_became_active":"2026-02-13T03:45:23.349223+0000","last_became_peered":"2026-02-13T03:45:23.349223+0000","last_unstale":"2026-02-13T03:45:25.421381+0000","last_undegraded":"2026-02-13T03:45:25.421381+0000","last_fullsized":"2026-02-13T03:45:25.421381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:38:18.742824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186170+0000","last_change":"2026-02-13T03:45:24.349832+0000","last_active":"2026-02-13T03:45:26.186170+0000","last_peered":"2026-02-13T03:45:26.186170+0000","last_clean":"2026-02-13T03:45:26.186170+0000","last_became_active":"2026-02-13T03:45:24.349608+0000","last_became_peered":"2026-02-13T03:45:24.349608+0000","last_unstale":"2026-02-13T03:45:26.186170+0000","last_undegraded":"2026-02-13T03:45:26.186170+0000","last_fullsized":"2026-02-13T03:45:26.186170+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:45:53.372675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186175+0000","last_change":"2026-02-13T03:45:23.352560+0000","last_active":"2026-02-13T03:45:26.186175+0000","last_peered":"2026-02-13T03:45:26.186175+0000","last_clean":"2026-02-13T03:45:26.186175+0000","last_became_active":"2026-02-13T03:45:23.352373+0000","last_became_peered":"2026-02-13T03:45:23.352373+0000","last_unstale":"2026-02-13T03:45:26.186175+0000","last_undegraded":"2026-02-13T03:45:26.186175+0000","last_fullsized":"2026-02-13T03:45:26.186175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:13:31.193029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791006+0000","last_change":"2026-02-13T03:45:24.354558+0000","last_active":"2026-02-13T03:45:25.791006+0000","last_peered":"2026-02-13T03:45:25.791006+0000","last_clean":"2026-02-13T03:45:25.791006+0000","last_became_active":"2026-02-13T03:45:24.354213+0000","last_became_peered":"2026-02-13T03:45:24.354213+0000","last_unstale":"2026-02-13T03:45:25.791006+0000","last_undegraded":"2026-02-13T03:45:25.791006+0000","last_fullsized":"2026-02-13T03:45:25.791006+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:21.319355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421761+0000","last_change":"2026-02-13T03:45:23.350556+0000","last_active":"2026-02-13T03:45:25.421761+0000","last_peered":"2026-02-13T03:45:25.421761+0000","last_clean":"2026-02-13T03:45:25.421761+0000","last_became_active":"2026-02-13T03:45:23.349778+0000","last_became_peered":"2026-02-13T03:45:23.349778+0000","last_unstale":"2026-02-13T03:45:25.421761+0000","last_undegraded":"2026-02-13T03:45:25.421761+0000","last_fullsized":"2026-02-13T03:45:25.421761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:30:14.999945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186456+0000","last_change":"2026-02-13T03:45:24.356662+0000","last_active":"2026-02-13T03:45:26.186456+0000","last_peered":"2026-02-13T03:45:26.186456+0000","last_clean":"2026-02-13T03:45:26.186456+0000","last_became_active":"2026-02-13T03:45:24.356145+0000","last_became_peered":"2026-02-13T03:45:24.356145+0000","last_unstale":"2026-02-13T03:45:26.186456+0000","last_undegraded":"2026-02-13T03:45:26.186456+0000","last_fullsized":"2026-02-13T03:45:26.186456+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:52.281060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347168+0000","last_change":"2026-02-13T03:45:23.351917+0000","last_active":"2026-02-13T03:45:25.347168+0000","last_peered":"2026-02-13T03:45:25.347168+0000","last_clean":"2026-02-13T03:45:25.347168+0000","last_became_active":"2026-02-13T03:45:23.351794+0000","last_became_peered":"2026-02-13T03:45:23.351794+0000","last_unstale":"2026-02-13T03:45:25.347168+0000","last_undegraded":"2026-02-13T03:45:25.347168+0000","last_fullsized":"2026-02-13T03:45:25.347168+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:15.488304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186459+0000","last_change":"2026-02-13T03:45:24.352772+0000","last_active":"2026-02-13T03:45:26.186459+0000","last_peered":"2026-02-13T03:45:26.186459+0000","last_clean":"2026-02-13T03:45:26.186459+0000","last_became_active":"2026-02-13T03:45:24.352569+0000","last_became_peered":"2026-02-13T03:45:24.352569+0000","last_unstale":"2026-02-13T03:45:26.186459+0000","last_undegraded":"2026-02-13T03:45:26.186459+0000","last_fullsized":"2026-02-13T03:45:26.186459+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:33:13.188588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928147+0000","last_change":"2026-02-13T03:45:23.352357+0000","last_active":"2026-02-13T03:45:25.928147+0000","last_peered":"2026-02-13T03:45:25.928147+0000","last_clean":"2026-02-13T03:45:25.928147+0000","last_became_active":"2026-02-13T03:45:23.352192+0000","last_became_peered":"2026-02-13T03:45:23.352192+0000","last_unstale":"2026-02-13T03:45:25.928147+0000","last_undegraded":"2026-02-13T03:45:25.928147+0000","last_fullsized":"2026-02-13T03:45:25.928147+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:07:52.352111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186361+0000","last_change":"2026-02-13T03:45:24.351804+0000","last_active":"2026-02-13T03:45:26.186361+0000","last_peered":"2026-02-13T03:45:26.186361+0000","last_clean":"2026-02-13T03:45:26.186361+0000","last_became_active":"2026-02-13T03:45:24.351594+0000","last_became_peered":"2026-02-13T03:45:24.351594+0000","last_unstale":"2026-02-13T03:45:26.186361+0000","last_undegraded":"2026-02-13T03:45:26.186361+0000","last_fullsized":"2026-02-13T03:45:26.186361+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:26:57.857287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347214+0000","last_change":"2026-02-13T03:45:23.350776+0000","last_active":"2026-02-13T03:45:25.347214+0000","last_peered":"2026-02-13T03:45:25.347214+0000","last_clean":"2026-02-13T03:45:25.347214+0000","last_became_active":"2026-02-13T03:45:23.350640+0000","last_became_peered":"2026-02-13T03:45:23.350640+0000","last_unstale":"2026-02-13T03:45:25.347214+0000","last_undegraded":"2026-02-13T03:45:25.347214+0000","last_fullsized":"2026-02-13T03:45:25.347214+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:52:28.690330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850321+0000","last_change":"2026-02-13T03:45:24.353462+0000","last_active":"2026-02-13T03:45:25.850321+0000","last_peered":"2026-02-13T03:45:25.850321+0000","last_clean":"2026-02-13T03:45:25.850321+0000","last_became_active":"2026-02-13T03:45:24.353125+0000","last_became_peered":"2026-02-13T03:45:24.353125+0000","last_unstale":"2026-02-13T03:45:25.850321+0000","last_undegraded":"2026-02-13T03:45:25.850321+0000","last_fullsized":"2026-02-13T03:45:25.850321+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:28:11.227093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348198+0000","last_change":"2026-02-13T03:45:23.354142+0000","last_active":"2026-02-13T03:45:25.348198+0000","last_peered":"2026-02-13T03:45:25.348198+0000","last_clean":"2026-02-13T03:45:25.348198+0000","last_became_active":"2026-02-13T03:45:23.353998+0000","last_became_peered":"2026-02-13T03:45:23.353998+0000","last_unstale":"2026-02-13T03:45:25.348198+0000","last_undegraded":"2026-02-13T03:45:25.348198+0000","last_fullsized":"2026-02-13T03:45:25.348198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:38:02.155173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.353375+0000","last_change":"2026-02-13T03:45:24.352663+0000","last_active":"2026-02-13T03:45:24.353375+0000","last_peered":"2026-02-13T03:45:24.353375+0000","last_clean":"2026-02-13T03:45:24.353375+0000","last_became_active":"2026-02-13T03:45:24.352121+0000","last_became_peered":"2026-02-13T03:45:24.352121+0000","last_unstale":"2026-02-13T03:45:24.353375+0000","last_undegraded":"2026-02-13T03:45:24.353375+0000","last_fullsized":"2026-02-13T03:45:24.353375+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:12:46.500505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170156+0000","last_change":"2026-02-13T03:45:23.352681+0000","last_active":"2026-02-13T03:45:26.170156+0000","last_peered":"2026-02-13T03:45:26.170156+0000","last_clean":"2026-02-13T03:45:26.170156+0000","last_became_active":"2026-02-13T03:45:23.352549+0000","last_became_peered":"2026-02-13T03:45:23.352549+0000","last_unstale":"2026-02-13T03:45:26.170156+0000","last_undegraded":"2026-02-13T03:45:26.170156+0000","last_fullsized":"2026-02-13T03:45:26.170156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:19:36.419406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927843+0000","last_change":"2026-02-13T03:45:24.353993+0000","last_active":"2026-02-13T03:45:25.927843+0000","last_peered":"2026-02-13T03:45:25.927843+0000","last_clean":"2026-02-13T03:45:25.927843+0000","last_became_active":"2026-02-13T03:45:24.353849+0000","last_became_peered":"2026-02-13T03:45:24.353849+0000","last_unstale":"2026-02-13T03:45:25.927843+0000","last_undegraded":"2026-02-13T03:45:25.927843+0000","last_fullsized":"2026-02-13T03:45:25.927843+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:37:28.284522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850035+0000","last_change":"2026-02-13T03:45:23.350245+0000","last_active":"2026-02-13T03:45:25.850035+0000","last_peered":"2026-02-13T03:45:25.850035+0000","last_clean":"2026-02-13T03:45:25.850035+0000","last_became_active":"2026-02-13T03:45:23.349993+0000","last_became_peered":"2026-02-13T03:45:23.349993+0000","last_unstale":"2026-02-13T03:45:25.850035+0000","last_undegraded":"2026-02-13T03:45:25.850035+0000","last_fullsized":"2026-02-13T03:45:25.850035+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:26.787163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347702+0000","last_change":"2026-02-13T03:45:24.357857+0000","last_active":"2026-02-13T03:45:25.347702+0000","last_peered":"2026-02-13T03:45:25.347702+0000","last_clean":"2026-02-13T03:45:25.347702+0000","last_became_active":"2026-02-13T03:45:24.357686+0000","last_became_peered":"2026-02-13T03:45:24.357686+0000","last_unstale":"2026-02-13T03:45:25.347702+0000","last_undegraded":"2026-02-13T03:45:25.347702+0000","last_fullsized":"2026-02-13T03:45:25.347702+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:18:49.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.185913+0000","last_change":"2026-02-13T03:45:23.349986+0000","last_active":"2026-02-13T03:45:26.185913+0000","last_peered":"2026-02-13T03:45:26.185913+0000","last_clean":"2026-02-13T03:45:26.185913+0000","last_became_active":"2026-02-13T03:45:23.349724+0000","last_became_peered":"2026-02-13T03:45:23.349724+0000","last_unstale":"2026-02-13T03:45:26.185913+0000","last_undegraded":"2026-02-13T03:45:26.185913+0000","last_fullsized":"2026-02-13T03:45:26.185913+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:17:32.924039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850162+0000","last_change":"2026-02-13T03:45:24.354082+0000","last_active":"2026-02-13T03:45:25.850162+0000","last_peered":"2026-02-13T03:45:25.850162+0000","last_clean":"2026-02-13T03:45:25.850162+0000","last_became_active":"2026-02-13T03:45:24.353693+0000","last_became_peered":"2026-02-13T03:45:24.353693+0000","last_unstale":"2026-02-13T03:45:25.850162+0000","last_undegraded":"2026-02-13T03:45:25.850162+0000","last_fullsized":"2026-02-13T03:45:25.850162+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:56.149445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"69'2","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927928+0000","last_change":"2026-02-13T03:45:23.349449+0000","last_active":"2026-02-13T03:45:25.927928+0000","last_peered":"2026-02-13T03:45:25.927928+0000","last_clean":"2026-02-13T03:45:25.927928+0000","last_became_active":"2026-02-13T03:45:23.349088+0000","last_became_peered":"2026-02-13T03:45:23.349088+0000","last_unstale":"2026-02-13T03:45:25.927928+0000","last_undegraded":"2026-02-13T03:45:25.927928+0000","last_fullsized":"2026-02-13T03:45:25.927928+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:47:08.987853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421786+0000","last_change":"2026-02-13T03:45:24.353460+0000","last_active":"2026-02-13T03:45:25.421786+0000","last_peered":"2026-02-13T03:45:25.421786+0000","last_clean":"2026-02-13T03:45:25.421786+0000","last_became_active":"2026-02-13T03:45:24.353234+0000","last_became_peered":"2026-02-13T03:45:24.353234+0000","last_unstale":"2026-02-13T03:45:25.421786+0000","last_undegraded":"2026-02-13T03:45:25.421786+0000","last_fullsized":"2026-02-13T03:45:25.421786+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:37.604254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791188+0000","last_change":"2026-02-13T03:45:24.356273+0000","last_active":"2026-02-13T03:45:25.791188+0000","last_peered":"2026-02-13T03:45:25.791188+0000","last_clean":"2026-02-13T03:45:25.791188+0000","last_became_active":"2026-02-13T03:45:24.355811+0000","last_became_peered":"2026-02-13T03:45:24.355811+0000","last_unstale":"2026-02-13T03:45:25.791188+0000","last_undegraded":"2026-02-13T03:45:25.791188+0000","last_fullsized":"2026-02-13T03:45:25.791188+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:16:38.126683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928123+0000","last_change":"2026-02-13T03:45:23.348661+0000","last_active":"2026-02-13T03:45:25.928123+0000","last_peered":"2026-02-13T03:45:25.928123+0000","last_clean":"2026-02-13T03:45:25.928123+0000","last_became_active":"2026-02-13T03:45:23.348261+0000","last_became_peered":"2026-02-13T03:45:23.348261+0000","last_unstale":"2026-02-13T03:45:25.928123+0000","last_undegraded":"2026-02-13T03:45:25.928123+0000","last_fullsized":"2026-02-13T03:45:25.928123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:55.257025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170184+0000","last_change":"2026-02-13T03:45:24.354121+0000","last_active":"2026-02-13T03:45:26.170184+0000","last_peered":"2026-02-13T03:45:26.170184+0000","last_clean":"2026-02-13T03:45:26.170184+0000","last_became_active":"2026-02-13T03:45:24.354004+0000","last_became_peered":"2026-02-13T03:45:24.354004+0000","last_unstale":"2026-02-13T03:45:26.170184+0000","last_undegraded":"2026-02-13T03:45:26.170184+0000","last_fullsized":"2026-02-13T03:45:26.170184+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:23:50.879001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928021+0000","last_change":"2026-02-13T03:45:23.348978+0000","last_active":"2026-02-13T03:45:25.928021+0000","last_peered":"2026-02-13T03:45:25.928021+0000","last_clean":"2026-02-13T03:45:25.928021+0000","last_became_active":"2026-02-13T03:45:23.348824+0000","last_became_peered":"2026-02-13T03:45:23.348824+0000","last_unstale":"2026-02-13T03:45:25.928021+0000","last_undegraded":"2026-02-13T03:45:25.928021+0000","last_fullsized":"2026-02-13T03:45:25.928021+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:46:48.932535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-13T03:45:24.355048+0000","last_change":"2026-02-13T03:45:24.354516+0000","last_active":"2026-02-13T03:45:24.355048+0000","last_peered":"2026-02-13T03:45:24.355048+0000","last_clean":"2026-02-13T03:45:24.355048+0000","last_became_active":"2026-02-13T03:45:24.353042+0000","last_became_peered":"2026-02-13T03:45:24.353042+0000","last_unstale":"2026-02-13T03:45:24.355048+0000","last_undegraded":"2026-02-13T03:45:24.355048+0000","last_fullsized":"2026-02-13T03:45:24.355048+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:49:18.521398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850303+0000","last_change":"2026-02-13T03:45:23.353085+0000","last_active":"2026-02-13T03:45:25.850303+0000","last_peered":"2026-02-13T03:45:25.850303+0000","last_clean":"2026-02-13T03:45:25.850303+0000","last_became_active":"2026-02-13T03:45:23.352945+0000","last_became_peered":"2026-02-13T03:45:23.352945+0000","last_unstale":"2026-02-13T03:45:25.850303+0000","last_undegraded":"2026-02-13T03:45:25.850303+0000","last_fullsized":"2026-02-13T03:45:25.850303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:59.326051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850314+0000","last_change":"2026-02-13T03:45:24.356661+0000","last_active":"2026-02-13T03:45:25.850314+0000","last_peered":"2026-02-13T03:45:25.850314+0000","last_clean":"2026-02-13T03:45:25.850314+0000","last_became_active":"2026-02-13T03:45:24.356440+0000","last_became_peered":"2026-02-13T03:45:24.356440+0000","last_unstale":"2026-02-13T03:45:25.850314+0000","last_undegraded":"2026-02-13T03:45:25.850314+0000","last_fullsized":"2026-02-13T03:45:25.850314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:20.190644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"69'4","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347192+0000","last_change":"2026-02-13T03:45:23.349442+0000","last_active":"2026-02-13T03:45:25.347192+0000","last_peered":"2026-02-13T03:45:25.347192+0000","last_clean":"2026-02-13T03:45:25.347192+0000","last_became_active":"2026-02-13T03:45:23.349265+0000","last_became_peered":"2026-02-13T03:45:23.349265+0000","last_unstale":"2026-02-13T03:45:25.347192+0000","last_undegraded":"2026-02-13T03:45:25.347192+0000","last_fullsized":"2026-02-13T03:45:25.347192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:08:11.896196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":9205,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":38073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58719,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":299612,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874247,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":365060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8466,"internal_metadata":27582190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":58,"seq":249108103176,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":957256,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":18705,"internal_metadata":27571951},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928233993,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15636,"internal_metadata":27575020},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27712,"kb_used_data":748,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":733975488,"statfs":{"total":751619276800,"available":751590899712,"internally_reserved":0,"allocated":765952,"data_stored":365686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21090,"internal_metadata":27569566},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":40,"seq":171798691851,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":956032,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23850,"internal_metadata":27566806},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":36,"seq":154618822670,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":365060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19432,"internal_metadata":27571224},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":29,"seq":124554051599,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":955610,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":12636,"internal_metadata":27578020},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":26,"seq":111669149712,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30605,"internal_metadata":27560051},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378642,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27712,"kb_used_data":748,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975488,"statfs":{"total":751619276800,"available":751590899712,"internally_reserved":0,"allocated":765952,"data_stored":365164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32541,"internal_metadata":27558115},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27744,"kb_used_data":780,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975456,"statfs":{"total":751619276800,"available":751590866944,"internally_reserved":0,"allocated":798720,"data_stored":390688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49132,"internal_metadata":27541524},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672980,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27716,"kb_used_data":752,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975484,"statfs":{"total":751619276800,"available":751590895616,"internally_reserved":0,"allocated":770048,"data_stored":366694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40057,"internal_metadata":27550599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27680,"kb_used_data":716,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975520,"statfs":{"total":751619276800,"available":751590932480,"internally_reserved":0,"allocated":733184,"data_stored":347838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37430,"internal_metadata":27553226},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3725,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":25628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8260,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15976,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8820,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2208,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":778,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3371,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":8579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10968,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3420,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T03:45:31.580 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T03:45:31.581 INFO:tasks.cephadm:Setting up client nodes... 2026-02-13T03:45:31.581 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T03:45:31.732 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 -- 10.20.193.70:0/3416639423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110a00 msgr2=0x7fb6ec171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/3416639423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110a00 0x7fb6ec171390 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=13234444306057863551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e800aa40 tx=0x7fb6e802fdf0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 -- 10.20.193.70:0/3416639423 shutdown_connections 2026-02-13T03:45:31.855 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/3416639423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110a00 0x7fb6ec171390 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=13234444306057863551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/3416639423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6ec110050 0x7fb6ec1104c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/3416639423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb6ec10eed0 0x7fb6ec10f2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 -- 10.20.193.70:0/3416639423 >> 10.20.193.70:0/3416639423 conn(0x7fb6ec0ec5f0 msgr2=0x7fb6ec10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 -- 10.20.193.70:0/3416639423 shutdown_connections 2026-02-13T03:45:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 -- 10.20.193.70:0/3416639423 wait complete. 2026-02-13T03:45:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 Processor -- start 2026-02-13T03:45:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 -- start start 2026-02-13T03:45:31.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6ec10eed0 0x7fb6ec0f8610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110050 0x7fb6ec171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb6ec110a00 0x7fb6ec0f8e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ec0f9a10 con 0x7fb6ec110050 2026-02-13T03:45:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ec0f9b80 con 0x7fb6ec10eed0 2026-02-13T03:45:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f38406c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ec0f9d40 con 0x7fb6ec110a00 2026-02-13T03:45:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f0db46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110050 0x7fb6ec171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f0db46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110050 0x7fb6ec171370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33660/0 (socket says 10.20.193.70:33660) 2026-02-13T03:45:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f0db46c0 1 -- 10.20.193.70:0/47161732 learned_addr learned my addr 10.20.193.70:0/47161732 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f15b56c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6ec10eed0 0x7fb6ec0f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f1db66c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb6ec110a00 0x7fb6ec0f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f0db46c0 1 -- 10.20.193.70:0/47161732 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb6ec110a00 msgr2=0x7fb6ec0f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f0db46c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb6ec110a00 0x7fb6ec0f8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f0db46c0 1 -- 10.20.193.70:0/47161732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6ec10eed0 msgr2=0x7fb6ec0f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f0db46c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6ec10eed0 0x7fb6ec0f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.849+0000 7fb6f0db46c0 1 -- 10.20.193.70:0/47161732 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e800a660 con 0x7fb6ec110050 2026-02-13T03:45:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.850+0000 7fb6f0db46c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110050 0x7fb6ec171370 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e000b6c0 tx=0x7fb6e000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.850+0000 7fb6da7fc6c0 1 -- 10.20.193.70:0/47161732 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e0004560 con 0x7fb6ec110050 2026-02-13T03:45:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.850+0000 7fb6da7fc6c0 1 -- 10.20.193.70:0/47161732 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb6e0009030 con 0x7fb6ec110050 2026-02-13T03:45:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.850+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6ec0f9fc0 con 0x7fb6ec110050 2026-02-13T03:45:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.850+0000 7fb6da7fc6c0 1 -- 10.20.193.70:0/47161732 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6e000cd90 con 0x7fb6ec110050 2026-02-13T03:45:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.850+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6ec0fa4f0 con 0x7fb6ec110050 2026-02-13T03:45:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.850+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6ec1752c0 con 0x7fb6ec110050 2026-02-13T03:45:31.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.851+0000 7fb6da7fc6c0 1 -- 10.20.193.70:0/47161732 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fb6e00026b0 con 0x7fb6ec110050 2026-02-13T03:45:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.852+0000 7fb6da7fc6c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6c80b5710 0x7fb6c80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.852+0000 7fb6f15b56c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6c80b5710 0x7fb6c80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.852+0000 7fb6da7fc6c0 1 -- 10.20.193.70:0/47161732 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fb6e00e3990 con 0x7fb6ec110050 2026-02-13T03:45:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.852+0000 7fb6f15b56c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6c80b5710 0x7fb6c80d5bc0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6dc005980 tx=0x7fb6dc005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:31.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.853+0000 7fb6da7fc6c0 1 -- 10.20.193.70:0/47161732 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb6e00a63b0 con 0x7fb6ec110050 2026-02-13T03:45:31.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.984+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fb6ec10f2c0 con 0x7fb6ec110050 2026-02-13T03:45:31.987 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.985+0000 7fb6da7fc6c0 1 -- 10.20.193.70:0/47161732 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7fb6e00a9560 con 0x7fb6ec110050 2026-02-13T03:45:31.988 INFO:teuthology.orchestra.run.trial070.stdout:[client.0] 2026-02-13T03:45:31.988 INFO:teuthology.orchestra.run.trial070.stdout: key = AQBbno5pdoTJOhAARue7yQ48/O22DLdQmvFI9A== 2026-02-13T03:45:31.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6c80b5710 msgr2=0x7fb6c80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6c80b5710 0x7fb6c80d5bc0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6dc005980 tx=0x7fb6dc005910 comp rx=0 tx=0).stop 2026-02-13T03:45:31.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110050 msgr2=0x7fb6ec171370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:31.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110050 0x7fb6ec171370 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6e000b6c0 tx=0x7fb6e000bb90 comp rx=0 tx=0).stop 2026-02-13T03:45:31.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 shutdown_connections 2026-02-13T03:45:31.990 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6c80b5710 0x7fb6c80d5bc0 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.990 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb6ec110a00 0x7fb6ec0f8e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.990 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb6ec110050 0x7fb6ec171370 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.990 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 --2- 10.20.193.70:0/47161732 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb6ec10eed0 0x7fb6ec0f8610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:31.990 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 >> 10.20.193.70:0/47161732 conn(0x7fb6ec0ec5f0 msgr2=0x7fb6ec0eeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:31.990 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 shutdown_connections 2026-02-13T03:45:31.990 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:31.987+0000 7fb6f38406c0 1 -- 10.20.193.70:0/47161732 wait complete. 2026-02-13T03:45:32.029 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-13T03:45:32.030 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-13T03:45:32.030 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T03:45:32.064 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-13T03:45:32.125 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:31 trial070 ceph-mon[24757]: mgrmap e12: x(active, since 2m), standbys: z, y 2026-02-13T03:45:32.125 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:31 trial070 ceph-mon[24757]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:32.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:31 trial177 ceph-mon[27082]: mgrmap e12: x(active, since 2m), standbys: z, y 2026-02-13T03:45:32.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:31 trial177 ceph-mon[27082]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:32.218 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:32.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:31 trial127 ceph-mon[26439]: mgrmap e12: x(active, since 2m), standbys: z, y 2026-02-13T03:45:32.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:31 trial127 ceph-mon[26439]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:32.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.340+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1323329959 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 msgr2=0x7f6e1c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.340+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1323329959 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 0x7f6e1c10f600 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=4073925750555298281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e0c0099a0 tx=0x7f6e0c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:32.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.340+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1323329959 shutdown_connections 2026-02-13T03:45:32.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.340+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1323329959 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e1c115440 0x7f6e1c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.340+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1323329959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e1c10fc20 0x7f6e1c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.340+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1323329959 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 0x7f6e1c10f600 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=4073925750555298281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.340+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1323329959 >> 10.20.193.70:0/1323329959 conn(0x7f6e1c0ecb30 msgr2=0x7f6e1c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.340+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1323329959 shutdown_connections 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.340+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1323329959 wait complete. 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 Processor -- start 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 -- start start 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 0x7f6e1c11d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e1c115440 0x7f6e1c11d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e1c122c20 0x7f6e1c1230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c123630 con 0x7f6e1c10f230 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c1237a0 con 0x7f6e1c115440 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c123960 con 0x7f6e1c122c20 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e21f486c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 0x7f6e1c11d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e21f486c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 0x7f6e1c11d320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33674/0 (socket says 10.20.193.70:33674) 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e21f486c0 1 -- 10.20.193.70:0/1661549219 learned_addr learned my addr 10.20.193.70:0/1661549219 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e21f486c0 1 -- 10.20.193.70:0/1661549219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e1c122c20 msgr2=0x7f6e1c1230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e21f486c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e1c122c20 0x7f6e1c1230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e217476c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e1c115440 0x7f6e1c11d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e21f486c0 1 -- 10.20.193.70:0/1661549219 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e1c115440 msgr2=0x7f6e1c11d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e21f486c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e1c115440 0x7f6e1c11d860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e21f486c0 1 -- 10.20.193.70:0/1661549219 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c009590 con 0x7f6e1c10f230 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e217476c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e1c115440 0x7f6e1c11d860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e21f486c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 0x7f6e1c11d320 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e0c02f230 tx=0x7f6e0c02fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e0affd6c0 1 -- 10.20.193.70:0/1661549219 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e0c002ba0 con 0x7f6e1c10f230 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e0affd6c0 1 -- 10.20.193.70:0/1661549219 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6e0c002d00 con 0x7f6e1c10f230 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1c163db0 con 0x7f6e1c10f230 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e0affd6c0 1 -- 10.20.193.70:0/1661549219 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e0c0372f0 con 0x7f6e1c10f230 2026-02-13T03:45:32.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.341+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1c1641e0 con 0x7f6e1c10f230 2026-02-13T03:45:32.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.342+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e1c110500 con 0x7f6e1c10f230 2026-02-13T03:45:32.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.343+0000 7f6e0affd6c0 1 -- 10.20.193.70:0/1661549219 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f6e0c0078d0 con 0x7f6e1c10f230 2026-02-13T03:45:32.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.343+0000 7f6e0affd6c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6df80b5690 0x7f6df80d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:32.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.344+0000 7f6e217476c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6df80b5690 0x7f6df80d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:32.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.344+0000 7f6e0affd6c0 1 -- 10.20.193.70:0/1661549219 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f6e0c107cb0 con 0x7f6e1c10f230 2026-02-13T03:45:32.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.344+0000 7f6e0affd6c0 1 -- 10.20.193.70:0/1661549219 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6e0c0ca6d0 con 0x7f6e1c10f230 2026-02-13T03:45:32.346 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.344+0000 7f6e217476c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6df80b5690 0x7f6df80d5b40 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e1c123cb0 tx=0x7f6e10005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:32.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.441+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6e1c10fc20 con 0x7f6e1c10f230 2026-02-13T03:45:32.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.441+0000 7f6e0affd6c0 1 -- 10.20.193.70:0/1661549219 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) ==== 86+0+133 (secure 0 0 0) 0x7f6e0c0cd880 con 0x7f6e1c10f230 2026-02-13T03:45:32.443 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6df80b5690 msgr2=0x7f6df80d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6df80b5690 0x7f6df80d5b40 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e1c123cb0 tx=0x7f6e10005f10 comp rx=0 tx=0).stop 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 msgr2=0x7f6e1c11d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 0x7f6e1c11d320 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e0c02f230 tx=0x7f6e0c02fd40 comp rx=0 tx=0).stop 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 shutdown_connections 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6df80b5690 0x7f6df80d5b40 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e1c122c20 0x7f6e1c1230c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6e1c115440 0x7f6e1c11d860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 --2- 10.20.193.70:0/1661549219 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6e1c10f230 0x7f6e1c11d320 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 >> 10.20.193.70:0/1661549219 conn(0x7f6e1c0ecb30 msgr2=0x7f6e1c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 shutdown_connections 2026-02-13T03:45:32.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.443+0000 7f6e241d76c0 1 -- 10.20.193.70:0/1661549219 wait complete. 2026-02-13T03:45:32.485 INFO:teuthology.orchestra.run.trial070.stdout:[{"version":46,"timestamp":"2026-02-13T03:45:18.509517+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-13T03:45:32.485 INFO:tasks.ceph_manager:config epoch is 46 2026-02-13T03:45:32.486 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T03:45:32.486 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-13T03:45:32.486 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-13T03:45:32.643 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:32.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.762+0000 7f51440dd6c0 1 -- 10.20.193.70:0/1166247698 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c115440 msgr2=0x7f513c175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.762+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/1166247698 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c115440 0x7f513c175de0 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=18394457542284637347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f513800aa70 tx=0x7f513802fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.762+0000 7f51440dd6c0 1 -- 10.20.193.70:0/1166247698 shutdown_connections 2026-02-13T03:45:32.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.762+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/1166247698 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c115440 0x7f513c175de0 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=18394457542284637347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.762+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/1166247698 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f513c10fc20 0x7f513c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.762+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/1166247698 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f513c10f230 0x7f513c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.762+0000 7f51440dd6c0 1 -- 10.20.193.70:0/1166247698 >> 10.20.193.70:0/1166247698 conn(0x7f513c0ecb30 msgr2=0x7f513c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:32.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.762+0000 7f51440dd6c0 1 -- 10.20.193.70:0/1166247698 shutdown_connections 2026-02-13T03:45:32.764 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.762+0000 7f51440dd6c0 1 -- 10.20.193.70:0/1166247698 wait complete. 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 Processor -- start 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 -- start start 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f513c10f230 0x7f513c11d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f513c115440 0x7f513c11d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c122ae0 0x7f513c122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f513c1234f0 con 0x7f513c122ae0 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f513c123660 con 0x7f513c10f230 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f513c123820 con 0x7f513c115440 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514264f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c122ae0 0x7f513c122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514264f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c122ae0 0x7f513c122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33690/0 (socket says 10.20.193.70:33690) 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514264f6c0 1 -- 10.20.193.70:0/3878479835 learned_addr learned my addr 10.20.193.70:0/3878479835 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f5141e4e6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f513c10f230 0x7f513c11d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514164d6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f513c115440 0x7f513c11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514264f6c0 1 -- 10.20.193.70:0/3878479835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f513c115440 msgr2=0x7f513c11d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514264f6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f513c115440 0x7f513c11d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514264f6c0 1 -- 10.20.193.70:0/3878479835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f513c10f230 msgr2=0x7f513c11d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514264f6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f513c10f230 0x7f513c11d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514264f6c0 1 -- 10.20.193.70:0/3878479835 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513800a660 con 0x7f513c122ae0 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f514264f6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c122ae0 0x7f513c122f80 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51380054b0 tx=0x7f51380054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f512affd6c0 1 -- 10.20.193.70:0/3878479835 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5138003a30 con 0x7f513c122ae0 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513c163c70 con 0x7f513c122ae0 2026-02-13T03:45:32.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f512affd6c0 1 -- 10.20.193.70:0/3878479835 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5138003b90 con 0x7f513c122ae0 2026-02-13T03:45:32.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f512affd6c0 1 -- 10.20.193.70:0/3878479835 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f51380382f0 con 0x7f513c122ae0 2026-02-13T03:45:32.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.763+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513c1640a0 con 0x7f513c122ae0 2026-02-13T03:45:32.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.764+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513c110500 con 0x7f513c122ae0 2026-02-13T03:45:32.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.765+0000 7f512affd6c0 1 -- 10.20.193.70:0/3878479835 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f5138008260 con 0x7f513c122ae0 2026-02-13T03:45:32.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.765+0000 7f512affd6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f51180b5690 0x7f51180d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:32.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.765+0000 7f5141e4e6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f51180b5690 0x7f51180d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:32.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.765+0000 7f512affd6c0 1 -- 10.20.193.70:0/3878479835 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f5138108e70 con 0x7f513c122ae0 2026-02-13T03:45:32.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.766+0000 7f5141e4e6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f51180b5690 0x7f51180d5b40 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f512c004750 tx=0x7f512c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:32.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.766+0000 7f512affd6c0 1 -- 10.20.193.70:0/3878479835 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f51380cb8d0 con 0x7f513c122ae0 2026-02-13T03:45:32.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.885+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f513c11e330 con 0x7f513c122ae0 2026-02-13T03:45:32.890 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.888+0000 7f512affd6c0 1 -- 10.20.193.70:0/3878479835 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v12) ==== 74+0+297577 (secure 0 0 0) 0x7f51380cea80 con 0x7f513c122ae0 2026-02-13T03:45:32.895 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:32.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f51180b5690 msgr2=0x7f51180d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f51180b5690 0x7f51180d5b40 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f512c004750 tx=0x7f512c009260 comp rx=0 tx=0).stop 2026-02-13T03:45:32.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c122ae0 msgr2=0x7f513c122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:32.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c122ae0 0x7f513c122f80 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51380054b0 tx=0x7f51380054e0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 shutdown_connections 2026-02-13T03:45:32.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f51180b5690 0x7f51180d5b40 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f513c122ae0 0x7f513c122f80 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f513c115440 0x7f513c11d720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 --2- 10.20.193.70:0/3878479835 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f513c10f230 0x7f513c11d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:32.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 >> 10.20.193.70:0/3878479835 conn(0x7f513c0ecb30 msgr2=0x7f513c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:32.899 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 shutdown_connections 2026-02-13T03:45:32.900 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:32.890+0000 7f51440dd6c0 1 -- 10.20.193.70:0/3878479835 wait complete. 2026-02-13T03:45:32.934 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":12,"flags":0,"active_gid":14116,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6800","nonce":1747996128},{"type":"v1","addr":"10.20.193.70:6801","nonce":1747996128}]},"active_addr":"10.20.193.70:6801/1747996128","active_change":"2026-02-13T03:43:02.018750+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":14355,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":14367,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":2,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.70:0","nonce":2042287192}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.70:0","nonce":3800154412}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.70:0","nonce":207846087}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.70:0","nonce":566713926}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.70:0","nonce":1147897469}]}]} 2026-02-13T03:45:32.944 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-13T03:45:32.944 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-13T03:45:32.945 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:45:32.996 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:32 trial070 ceph-mon[24757]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:32.996 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:32 trial070 ceph-mon[24757]: pgmap v190: 97 pgs: 97 active+clean; 586 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2026-02-13T03:45:32.996 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/47161732' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T03:45:32.996 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/47161732' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T03:45:32.996 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1661549219' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T03:45:32.996 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3878479835' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T03:45:33.090 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:32 trial177 ceph-mon[27082]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:33.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:32 trial177 ceph-mon[27082]: pgmap v190: 97 pgs: 97 active+clean; 586 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2026-02-13T03:45:33.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/47161732' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T03:45:33.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/47161732' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T03:45:33.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1661549219' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T03:45:33.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3878479835' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T03:45:33.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.208+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/2293714372 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d410fc20 msgr2=0x7f91d4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.208+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/2293714372 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d410fc20 0x7f91d4114c60 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=2729859677551753767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91c80099a0 tx=0x7f91c802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.208+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/2293714372 shutdown_connections 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.208+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/2293714372 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d4115440 0x7f91d4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.208+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/2293714372 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d410fc20 0x7f91d4114c60 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=2729859677551753767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.208+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/2293714372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91d410f230 0x7f91d410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.208+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/2293714372 >> 10.20.193.70:0/2293714372 conn(0x7f91d40ecb30 msgr2=0x7f91d410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.208+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/2293714372 shutdown_connections 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.208+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/2293714372 wait complete. 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 Processor -- start 2026-02-13T03:45:33.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 -- start start 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91d410f230 0x7f91d40f4c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d4115440 0x7f91d4175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d40f5290 0x7f91d40fa560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40f5980 con 0x7f91d40f5290 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40faaa0 con 0x7f91d410f230 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40fac60 con 0x7f91d4115440 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91daa5a6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d40f5290 0x7f91d40fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91daa5a6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d40f5290 0x7f91d40fa560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33696/0 (socket says 10.20.193.70:33696) 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91daa5a6c0 1 -- 10.20.193.70:0/840782958 learned_addr learned my addr 10.20.193.70:0/840782958 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91d9a586c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d4115440 0x7f91d4175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:33.214 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91da2596c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91d410f230 0x7f91d40f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:33.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91daa5a6c0 1 -- 10.20.193.70:0/840782958 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d4115440 msgr2=0x7f91d4175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91daa5a6c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d4115440 0x7f91d4175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91daa5a6c0 1 -- 10.20.193.70:0/840782958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91d410f230 msgr2=0x7f91d40f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91daa5a6c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91d410f230 0x7f91d40f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91daa5a6c0 1 -- 10.20.193.70:0/840782958 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c8009590 con 0x7f91d40f5290 2026-02-13T03:45:33.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91da2596c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91d410f230 0x7f91d40f4c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:33.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91daa5a6c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d40f5290 0x7f91d40fa560 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d0006ea0 tx=0x7f91d000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:33.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91bb7fe6c0 1 -- 10.20.193.70:0/840782958 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91d0003c40 con 0x7f91d40f5290 2026-02-13T03:45:33.215 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91bb7fe6c0 1 -- 10.20.193.70:0/840782958 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f91d0003da0 con 0x7f91d40f5290 2026-02-13T03:45:33.216 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d40faf40 con 0x7f91d40f5290 2026-02-13T03:45:33.216 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91bb7fe6c0 1 -- 10.20.193.70:0/840782958 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91d00081c0 con 0x7f91d40f5290 2026-02-13T03:45:33.216 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.209+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d40fb6d0 con 0x7f91d40f5290 2026-02-13T03:45:33.216 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.210+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d40fb420 con 0x7f91d40f5290 2026-02-13T03:45:33.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.211+0000 7f91bb7fe6c0 1 -- 10.20.193.70:0/840782958 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f91d0005860 con 0x7f91d40f5290 2026-02-13T03:45:33.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.211+0000 7f91bb7fe6c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91b00b5710 0x7f91b00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:33.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.212+0000 7f91da2596c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91b00b5710 0x7f91b00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:33.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.212+0000 7f91bb7fe6c0 1 -- 10.20.193.70:0/840782958 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f91d00e4b00 con 0x7f91d40f5290 2026-02-13T03:45:33.217 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.212+0000 7f91da2596c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91b00b5710 0x7f91b00d5bc0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91c4005dc0 tx=0x7f91c4005f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:33.218 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.212+0000 7f91bb7fe6c0 1 -- 10.20.193.70:0/840782958 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f91d00a7560 con 0x7f91d40f5290 2026-02-13T03:45:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:32 trial127 ceph-mon[26439]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:32 trial127 ceph-mon[26439]: pgmap v190: 97 pgs: 97 active+clean; 586 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2026-02-13T03:45:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/47161732' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T03:45:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/47161732' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T03:45:33.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1661549219' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T03:45:33.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3878479835' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T03:45:33.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.306+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91d4110500 con 0x7f91d40f5290 2026-02-13T03:45:33.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.307+0000 7f91bb7fe6c0 1 -- 10.20.193.70:0/840782958 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+22060 (secure 0 0 0) 0x7f91d00aa710 con 0x7f91d40f5290 2026-02-13T03:45:33.310 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:33.310 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":70,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","created":"2026-02-13T03:42:55.979106+0000","modified":"2026-02-13T03:45:25.344859+0000","last_up_change":"2026-02-13T03:45:06.144024+0000","last_in_change":"2026-02-13T03:44:57.854565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:43:58.913146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:45:21.488475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:45:22.732576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76aee801-8323-41e6-8540-7d0b5fa666e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6802","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6803","nonce":1468748446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6804","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6805","nonce":1468748446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6808","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6809","nonce":1468748446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6806","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6807","nonce":1468748446}]},"public_addr":"10.20.193.70:6803/1468748446","cluster_addr":"10.20.193.70:6805/1468748446","heartbeat_back_addr":"10.20.193.70:6809/1468748446","heartbeat_front_addr":"10.20.193.70:6807/1468748446","state":["exists","up"]},{"osd":1,"uuid":"621ea3ce-4cd8-4150-a1ba-f4e189f680bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6801","nonce":3454251527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6803","nonce":3454251527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6807","nonce":3454251527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6805","nonce":3454251527}]},"public_addr":"10.20.193.127:6801/3454251527","cluster_addr":"10.20.193.127:6803/3454251527","heartbeat_back_addr":"10.20.193.127:6807/3454251527","heartbeat_front_addr":"10.20.193.127:6805/3454251527","state":["exists","up"]},{"osd":2,"uuid":"17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6801","nonce":2599066943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6803","nonce":2599066943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6807","nonce":2599066943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6805","nonce":2599066943}]},"public_addr":"10.20.193.177:6801/2599066943","cluster_addr":"10.20.193.177:6803/2599066943","heartbeat_back_addr":"10.20.193.177:6807/2599066943","heartbeat_front_addr":"10.20.193.177:6805/2599066943","state":["exists","up"]},{"osd":3,"uuid":"31edcb70-f683-4525-b2c3-348788484124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6810","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6811","nonce":3715748086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6812","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6813","nonce":3715748086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6816","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6817","nonce":3715748086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6814","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6815","nonce":3715748086}]},"public_addr":"10.20.193.70:6811/3715748086","cluster_addr":"10.20.193.70:6813/3715748086","heartbeat_back_addr":"10.20.193.70:6817/3715748086","heartbeat_front_addr":"10.20.193.70:6815/3715748086","state":["exists","up"]},{"osd":4,"uuid":"82a40ce4-8f67-4a58-b08d-d7bfdbd447ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6809","nonce":2954348410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6811","nonce":2954348410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6815","nonce":2954348410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6813","nonce":2954348410}]},"public_addr":"10.20.193.127:6809/2954348410","cluster_addr":"10.20.193.127:6811/2954348410","heartbeat_back_addr":"10.20.193.127:6815/2954348410","heartbeat_front_addr":"10.20.193.127:6813/2954348410","state":["exists","up"]},{"osd":5,"uuid":"f96cee85-6197-423b-a006-6d2d85772d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6809","nonce":2878984246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6811","nonce":2878984246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6815","nonce":2878984246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6813","nonce":2878984246}]},"public_addr":"10.20.193.177:6809/2878984246","cluster_addr":"10.20.193.177:6811/2878984246","heartbeat_back_addr":"10.20.193.177:6815/2878984246","heartbeat_front_addr":"10.20.193.177:6813/2878984246","state":["exists","up"]},{"osd":6,"uuid":"8703f159-2f0c-4744-8797-960d48eedfc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6818","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6819","nonce":192941608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6820","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6821","nonce":192941608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6824","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6825","nonce":192941608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6822","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6823","nonce":192941608}]},"public_addr":"10.20.193.70:6819/192941608","cluster_addr":"10.20.193.70:6821/192941608","heartbeat_back_addr":"10.20.193.70:6825/192941608","heartbeat_front_addr":"10.20.193.70:6823/192941608","state":["exists","up"]},{"osd":7,"uuid":"7203c134-bbbb-4980-b512-a49cb17481d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6817","nonce":3503194265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6819","nonce":3503194265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6823","nonce":3503194265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6821","nonce":3503194265}]},"public_addr":"10.20.193.127:6817/3503194265","cluster_addr":"10.20.193.127:6819/3503194265","heartbeat_back_addr":"10.20.193.127:6823/3503194265","heartbeat_front_addr":"10.20.193.127:6821/3503194265","state":["exists","up"]},{"osd":8,"uuid":"1771e760-778b-4f83-a0c5-12eeee43c768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6817","nonce":2623744285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6819","nonce":2623744285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6823","nonce":2623744285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6821","nonce":2623744285}]},"public_addr":"10.20.193.177:6817/2623744285","cluster_addr":"10.20.193.177:6819/2623744285","heartbeat_back_addr":"10.20.193.177:6823/2623744285","heartbeat_front_addr":"10.20.193.177:6821/2623744285","state":["exists","up"]},{"osd":9,"uuid":"2ad7ff96-14be-4cb9-9b52-1a00e064de38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6826","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6827","nonce":1992888403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6828","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6829","nonce":1992888403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6832","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6833","nonce":1992888403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6830","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6831","nonce":1992888403}]},"public_addr":"10.20.193.70:6827/1992888403","cluster_addr":"10.20.193.70:6829/1992888403","heartbeat_back_addr":"10.20.193.70:6833/1992888403","heartbeat_front_addr":"10.20.193.70:6831/1992888403","state":["exists","up"]},{"osd":10,"uuid":"3ca6791a-ad2b-4701-a67d-17e83888b9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6825","nonce":380098770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6827","nonce":380098770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6831","nonce":380098770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6829","nonce":380098770}]},"public_addr":"10.20.193.127:6825/380098770","cluster_addr":"10.20.193.127:6827/380098770","heartbeat_back_addr":"10.20.193.127:6831/380098770","heartbeat_front_addr":"10.20.193.127:6829/380098770","state":["exists","up"]},{"osd":11,"uuid":"0d51bb23-8f23-43b5-b697-ca294fd39e89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6825","nonce":3785556542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6827","nonce":3785556542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6831","nonce":3785556542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6829","nonce":3785556542}]},"public_addr":"10.20.193.177:6825/3785556542","cluster_addr":"10.20.193.177:6827/3785556542","heartbeat_back_addr":"10.20.193.177:6831/3785556542","heartbeat_front_addr":"10.20.193.177:6829/3785556542","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:43.223664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:50.561682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:57.716321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:05.230108+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:12.548595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:19.918131+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:27.198884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:34.668843+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:42.036449+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:49.563635+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:57.025291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:45:04.376713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.70:6801/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:6800/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/1475427018":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/2220510112":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/3723878791":"2026-02-14T03:43:02.018661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:45:33.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91b00b5710 msgr2=0x7f91b00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91b00b5710 0x7f91b00d5bc0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91c4005dc0 tx=0x7f91c4005f90 comp rx=0 tx=0).stop 2026-02-13T03:45:33.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d40f5290 msgr2=0x7f91d40fa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d40f5290 0x7f91d40fa560 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d0006ea0 tx=0x7f91d000ce50 comp rx=0 tx=0).stop 2026-02-13T03:45:33.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 shutdown_connections 2026-02-13T03:45:33.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91b00b5710 0x7f91b00d5bc0 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91d40f5290 0x7f91d40fa560 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d4115440 0x7f91d4175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 --2- 10.20.193.70:0/840782958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91d410f230 0x7f91d40f4c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 >> 10.20.193.70:0/840782958 conn(0x7f91d40ecb30 msgr2=0x7f91d410d930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:33.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 shutdown_connections 2026-02-13T03:45:33.314 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.308+0000 7f91dc4e86c0 1 -- 10.20.193.70:0/840782958 wait complete. 2026-02-13T03:45:33.353 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-13T03:45:33.353 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T03:45:33.510 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/1110680891 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb9810fc20 msgr2=0x7fcb98114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/1110680891 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb9810fc20 0x7fcb98114c60 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=8984418364344688618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb800099a0 tx=0x7fcb8002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/1110680891 shutdown_connections 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/1110680891 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb98115440 0x7fcb98175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/1110680891 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb9810fc20 0x7fcb98114c60 unknown :-1 s=CLOSED pgs=260 gs=1 cs=0 l=1 c_cookie=8984418364344688618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/1110680891 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb9810f230 0x7fcb9810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/1110680891 >> 10.20.193.70:0/1110680891 conn(0x7fcb980ecb30 msgr2=0x7fcb9810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/1110680891 shutdown_connections 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/1110680891 wait complete. 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 Processor -- start 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 -- start start 2026-02-13T03:45:33.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb9810f230 0x7fcb980f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb98115440 0x7fcb98175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb980f5310 0x7fcb980fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb980f5a00 con 0x7fcb98115440 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcb980faad0 con 0x7fcb9810f230 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9f2706c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb980fac90 con 0x7fcb980f5310 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb8ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb98115440 0x7fcb98175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb8ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb98115440 0x7fcb98175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33722/0 (socket says 10.20.193.70:33722) 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb8ffff6c0 1 -- 10.20.193.70:0/3697741299 learned_addr learned my addr 10.20.193.70:0/3697741299 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.619+0000 7fcb9cfe56c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb9810f230 0x7fcb980f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb8ffff6c0 1 -- 10.20.193.70:0/3697741299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb980f5310 msgr2=0x7fcb980fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb8ffff6c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb980f5310 0x7fcb980fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb8ffff6c0 1 -- 10.20.193.70:0/3697741299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb9810f230 msgr2=0x7fcb980f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb8ffff6c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb9810f230 0x7fcb980f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb8ffff6c0 1 -- 10.20.193.70:0/3697741299 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb80009590 con 0x7fcb98115440 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb8ffff6c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb98115440 0x7fcb98175ce0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb80004830 tx=0x7fcb8002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb8dffb6c0 1 -- 10.20.193.70:0/3697741299 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb80002ae0 con 0x7fcb98115440 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb8dffb6c0 1 -- 10.20.193.70:0/3697741299 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcb80002c40 con 0x7fcb98115440 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb980faf10 con 0x7fcb98115440 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb8dffb6c0 1 -- 10.20.193.70:0/3697741299 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb800362f0 con 0x7fcb98115440 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb980fb3b0 con 0x7fcb98115440 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.620+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb98110500 con 0x7fcb98115440 2026-02-13T03:45:33.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.621+0000 7fcb8dffb6c0 1 -- 10.20.193.70:0/3697741299 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fcb80007810 con 0x7fcb98115440 2026-02-13T03:45:33.628 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.622+0000 7fcb8dffb6c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:33.628 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.622+0000 7fcb9cfe56c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:33.628 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.622+0000 7fcb8dffb6c0 1 -- 10.20.193.70:0/3697741299 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fcb80107c30 con 0x7fcb98115440 2026-02-13T03:45:33.628 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.622+0000 7fcb9cfe56c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb88005980 tx=0x7fcb88005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:33.628 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.623+0000 7fcb8dffb6c0 1 -- 10.20.193.70:0/3697741299 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcb800ca650 con 0x7fcb98115440 2026-02-13T03:45:33.718 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.716+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb9810fc20 con 0x7fcb98115440 2026-02-13T03:45:33.718 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.716+0000 7fcb8dffb6c0 1 -- 10.20.193.70:0/3697741299 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+22060 (secure 0 0 0) 0x7fcb800cd800 con 0x7fcb98115440 2026-02-13T03:45:33.719 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:33.719 INFO:teuthology.orchestra.run.trial070.stdout:{"epoch":70,"fsid":"0c5cf8b4-088e-11f1-b830-d404e6e7d460","created":"2026-02-13T03:42:55.979106+0000","modified":"2026-02-13T03:45:25.344859+0000","last_up_change":"2026-02-13T03:45:06.144024+0000","last_in_change":"2026-02-13T03:44:57.854565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:43:58.913146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T03:45:21.488475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T03:45:22.732576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76aee801-8323-41e6-8540-7d0b5fa666e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6802","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6803","nonce":1468748446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6804","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6805","nonce":1468748446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6808","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6809","nonce":1468748446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6806","nonce":1468748446},{"type":"v1","addr":"10.20.193.70:6807","nonce":1468748446}]},"public_addr":"10.20.193.70:6803/1468748446","cluster_addr":"10.20.193.70:6805/1468748446","heartbeat_back_addr":"10.20.193.70:6809/1468748446","heartbeat_front_addr":"10.20.193.70:6807/1468748446","state":["exists","up"]},{"osd":1,"uuid":"621ea3ce-4cd8-4150-a1ba-f4e189f680bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6800","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6801","nonce":3454251527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6802","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6803","nonce":3454251527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6806","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6807","nonce":3454251527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6804","nonce":3454251527},{"type":"v1","addr":"10.20.193.127:6805","nonce":3454251527}]},"public_addr":"10.20.193.127:6801/3454251527","cluster_addr":"10.20.193.127:6803/3454251527","heartbeat_back_addr":"10.20.193.127:6807/3454251527","heartbeat_front_addr":"10.20.193.127:6805/3454251527","state":["exists","up"]},{"osd":2,"uuid":"17fa3a9a-1407-4cd3-9f4c-3dfdd3f0631c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6801","nonce":2599066943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6803","nonce":2599066943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6807","nonce":2599066943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":2599066943},{"type":"v1","addr":"10.20.193.177:6805","nonce":2599066943}]},"public_addr":"10.20.193.177:6801/2599066943","cluster_addr":"10.20.193.177:6803/2599066943","heartbeat_back_addr":"10.20.193.177:6807/2599066943","heartbeat_front_addr":"10.20.193.177:6805/2599066943","state":["exists","up"]},{"osd":3,"uuid":"31edcb70-f683-4525-b2c3-348788484124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6810","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6811","nonce":3715748086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6812","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6813","nonce":3715748086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6816","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6817","nonce":3715748086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6814","nonce":3715748086},{"type":"v1","addr":"10.20.193.70:6815","nonce":3715748086}]},"public_addr":"10.20.193.70:6811/3715748086","cluster_addr":"10.20.193.70:6813/3715748086","heartbeat_back_addr":"10.20.193.70:6817/3715748086","heartbeat_front_addr":"10.20.193.70:6815/3715748086","state":["exists","up"]},{"osd":4,"uuid":"82a40ce4-8f67-4a58-b08d-d7bfdbd447ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6808","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6809","nonce":2954348410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6810","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6811","nonce":2954348410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6814","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6815","nonce":2954348410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6812","nonce":2954348410},{"type":"v1","addr":"10.20.193.127:6813","nonce":2954348410}]},"public_addr":"10.20.193.127:6809/2954348410","cluster_addr":"10.20.193.127:6811/2954348410","heartbeat_back_addr":"10.20.193.127:6815/2954348410","heartbeat_front_addr":"10.20.193.127:6813/2954348410","state":["exists","up"]},{"osd":5,"uuid":"f96cee85-6197-423b-a006-6d2d85772d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6809","nonce":2878984246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6811","nonce":2878984246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6815","nonce":2878984246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2878984246},{"type":"v1","addr":"10.20.193.177:6813","nonce":2878984246}]},"public_addr":"10.20.193.177:6809/2878984246","cluster_addr":"10.20.193.177:6811/2878984246","heartbeat_back_addr":"10.20.193.177:6815/2878984246","heartbeat_front_addr":"10.20.193.177:6813/2878984246","state":["exists","up"]},{"osd":6,"uuid":"8703f159-2f0c-4744-8797-960d48eedfc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6818","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6819","nonce":192941608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6820","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6821","nonce":192941608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6824","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6825","nonce":192941608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6822","nonce":192941608},{"type":"v1","addr":"10.20.193.70:6823","nonce":192941608}]},"public_addr":"10.20.193.70:6819/192941608","cluster_addr":"10.20.193.70:6821/192941608","heartbeat_back_addr":"10.20.193.70:6825/192941608","heartbeat_front_addr":"10.20.193.70:6823/192941608","state":["exists","up"]},{"osd":7,"uuid":"7203c134-bbbb-4980-b512-a49cb17481d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6816","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6817","nonce":3503194265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6818","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6819","nonce":3503194265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6822","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6823","nonce":3503194265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6820","nonce":3503194265},{"type":"v1","addr":"10.20.193.127:6821","nonce":3503194265}]},"public_addr":"10.20.193.127:6817/3503194265","cluster_addr":"10.20.193.127:6819/3503194265","heartbeat_back_addr":"10.20.193.127:6823/3503194265","heartbeat_front_addr":"10.20.193.127:6821/3503194265","state":["exists","up"]},{"osd":8,"uuid":"1771e760-778b-4f83-a0c5-12eeee43c768","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6817","nonce":2623744285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6819","nonce":2623744285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6823","nonce":2623744285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":2623744285},{"type":"v1","addr":"10.20.193.177:6821","nonce":2623744285}]},"public_addr":"10.20.193.177:6817/2623744285","cluster_addr":"10.20.193.177:6819/2623744285","heartbeat_back_addr":"10.20.193.177:6823/2623744285","heartbeat_front_addr":"10.20.193.177:6821/2623744285","state":["exists","up"]},{"osd":9,"uuid":"2ad7ff96-14be-4cb9-9b52-1a00e064de38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6826","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6827","nonce":1992888403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6828","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6829","nonce":1992888403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6832","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6833","nonce":1992888403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.70:6830","nonce":1992888403},{"type":"v1","addr":"10.20.193.70:6831","nonce":1992888403}]},"public_addr":"10.20.193.70:6827/1992888403","cluster_addr":"10.20.193.70:6829/1992888403","heartbeat_back_addr":"10.20.193.70:6833/1992888403","heartbeat_front_addr":"10.20.193.70:6831/1992888403","state":["exists","up"]},{"osd":10,"uuid":"3ca6791a-ad2b-4701-a67d-17e83888b9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6824","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6825","nonce":380098770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6826","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6827","nonce":380098770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6830","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6831","nonce":380098770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.127:6828","nonce":380098770},{"type":"v1","addr":"10.20.193.127:6829","nonce":380098770}]},"public_addr":"10.20.193.127:6825/380098770","cluster_addr":"10.20.193.127:6827/380098770","heartbeat_back_addr":"10.20.193.127:6831/380098770","heartbeat_front_addr":"10.20.193.127:6829/380098770","state":["exists","up"]},{"osd":11,"uuid":"0d51bb23-8f23-43b5-b697-ca294fd39e89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6825","nonce":3785556542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6827","nonce":3785556542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6831","nonce":3785556542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3785556542},{"type":"v1","addr":"10.20.193.177:6829","nonce":3785556542}]},"public_addr":"10.20.193.177:6825/3785556542","cluster_addr":"10.20.193.177:6827/3785556542","heartbeat_back_addr":"10.20.193.177:6831/3785556542","heartbeat_front_addr":"10.20.193.177:6829/3785556542","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:43.223664+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:50.561682+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:43:57.716321+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:05.230108+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:12.548595+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:19.918131+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:27.198884+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:34.668843+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:42.036449+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:49.563635+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:44:57.025291+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:45:04.376713+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.70:6801/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:6800/982456317":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/1475427018":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/2220510112":"2026-02-14T03:43:02.018661+0000","10.20.193.70:0/3723878791":"2026-02-14T03:43:02.018661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T03:45:33.720 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.717+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 msgr2=0x7fcb740d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.720 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.717+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb88005980 tx=0x7fcb88005910 comp rx=0 tx=0).stop 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.717+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb98115440 msgr2=0x7fcb98175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.717+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb98115440 0x7fcb98175ce0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb80004830 tx=0x7fcb8002fbf0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.718+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 shutdown_connections 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.718+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 unknown :-1 s=CLOSED pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.718+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb980f5310 0x7fcb980fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.718+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcb98115440 0x7fcb98175ce0 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.718+0000 7fcb9f2706c0 1 --2- 10.20.193.70:0/3697741299 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcb9810f230 0x7fcb980f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.718+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 >> 10.20.193.70:0/3697741299 conn(0x7fcb980ecb30 msgr2=0x7fcb9810d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.718+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 shutdown_connections 2026-02-13T03:45:33.721 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:33.718+0000 7fcb9f2706c0 1 -- 10.20.193.70:0/3697741299 wait complete. 2026-02-13T03:45:33.762 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-13T03:45:33.763 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-13T03:45:33.763 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-13T03:45:33.764 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-13T03:45:33.764 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-13T03:45:33.765 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-13T03:45:33.765 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-13T03:45:33.765 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-13T03:45:33.766 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-13T03:45:33.767 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-13T03:45:33.767 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-13T03:45:33.768 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-13T03:45:33.904 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.905 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.905 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.906 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.906 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.910 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.911 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.911 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.912 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.913 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.917 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.923 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:33.934 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:33 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/840782958' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:33.934 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:33 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3697741299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:34.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.042+0000 7f78e69e46c0 1 -- 10.20.193.70:0/1161278665 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78e00607a0 msgr2=0x7f78e0060b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.042+0000 7f78e69e46c0 1 --2- 10.20.193.70:0/1161278665 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78e00607a0 0x7f78e0060b70 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=7388836729030324576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78cc009970 tx=0x7f78cc02ed70 comp rx=0 tx=0).stop 2026-02-13T03:45:34.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.042+0000 7f78e69e46c0 1 -- 10.20.193.70:0/1161278665 shutdown_connections 2026-02-13T03:45:34.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.042+0000 7f78e69e46c0 1 --2- 10.20.193.70:0/1161278665 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78e0155660 0x7f78e0175a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.042+0000 7f78e69e46c0 1 --2- 10.20.193.70:0/1161278665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78e00610b0 0x7f78e0155120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.042+0000 7f78e69e46c0 1 --2- 10.20.193.70:0/1161278665 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78e00607a0 0x7f78e0060b70 unknown :-1 s=CLOSED pgs=262 gs=1 cs=0 l=1 c_cookie=7388836729030324576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.042+0000 7f78e69e46c0 1 -- 10.20.193.70:0/1161278665 >> 10.20.193.70:0/1161278665 conn(0x7f78e00ea8b0 msgr2=0x7f78e010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.042+0000 7f78e69e46c0 1 -- 10.20.193.70:0/1161278665 shutdown_connections 2026-02-13T03:45:34.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.042+0000 7f78e69e46c0 1 -- 10.20.193.70:0/1161278665 wait complete. 2026-02-13T03:45:34.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.043+0000 7f78e69e46c0 1 Processor -- start 2026-02-13T03:45:34.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.043+0000 7f78e69e46c0 1 -- start start 2026-02-13T03:45:34.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.043+0000 7f78e69e46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78e00607a0 0x7f78e01614c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78e69e46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78e00610b0 0x7f78e0161a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78e69e46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78e0155660 0x7f78e0166dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78e69e46c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0167410 con 0x7f78e00610b0 2026-02-13T03:45:34.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78e69e46c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0167580 con 0x7f78e00607a0 2026-02-13T03:45:34.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78e69e46c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0167740 con 0x7f78e0155660 2026-02-13T03:45:34.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78df7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78e00610b0 0x7f78e0161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dffff6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78e00607a0 0x7f78e01614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dffff6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78e00607a0 0x7f78e01614c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:56770/0 (socket says 10.20.193.70:56770) 2026-02-13T03:45:34.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dffff6c0 1 -- 10.20.193.70:0/2192878238 learned_addr learned my addr 10.20.193.70:0/2192878238 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78e4f5a6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78e0155660 0x7f78e0166dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dffff6c0 1 -- 10.20.193.70:0/2192878238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78e0155660 msgr2=0x7f78e0166dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dffff6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f78e0155660 0x7f78e0166dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dffff6c0 1 -- 10.20.193.70:0/2192878238 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78e00610b0 msgr2=0x7f78e0161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dffff6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f78e00610b0 0x7f78e0161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dffff6c0 1 -- 10.20.193.70:0/2192878238 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc009590 con 0x7f78e00607a0 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dffff6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78e00607a0 0x7f78e01614c0 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78cc0023e0 tx=0x7f78cc02fc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dd7fa6c0 1 -- 10.20.193.70:0/2192878238 <== mon.2 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78cc002ba0 con 0x7f78e00607a0 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78dd7fa6c0 1 -- 10.20.193.70:0/2192878238 <== mon.2 v2:10.20.193.127:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f78cc002d00 con 0x7f78e00607a0 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.044+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e01679c0 con 0x7f78e00607a0 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f78dd7fa6c0 1 -- 10.20.193.70:0/2192878238 <== mon.2 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f78cc0372f0 con 0x7f78e00607a0 2026-02-13T03:45:34.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e010cbb0 con 0x7f78e00607a0 2026-02-13T03:45:34.051 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78e0052a50 con 0x7f78e00607a0 2026-02-13T03:45:34.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 -- 10.20.193.70:0/4179559801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f37cc10be60 msgr2=0x7f37cc10c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 --2- 10.20.193.70:0/4179559801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f37cc10be60 0x7f37cc10c230 secure :-1 s=READY pgs=55 gs=2 cs=0 l=1 c_cookie=4118773235183296681 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37bc00bb60 tx=0x7f37bc030ec0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 -- 10.20.193.70:0/4179559801 shutdown_connections 2026-02-13T03:45:34.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 --2- 10.20.193.70:0/4179559801 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f37cc112070 0x7f37cc172a10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 --2- 10.20.193.70:0/4179559801 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37cc10c850 0x7f37cc111890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 --2- 10.20.193.70:0/4179559801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f37cc10be60 0x7f37cc10c230 unknown :-1 s=CLOSED pgs=55 gs=2 cs=0 l=1 c_cookie=4118773235183296681 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 -- 10.20.193.70:0/4179559801 >> 10.20.193.70:0/4179559801 conn(0x7f37cc0e9740 msgr2=0x7f37cc109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 -- 10.20.193.70:0/4179559801 shutdown_connections 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 -- 10.20.193.70:0/4179559801 wait complete. 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 Processor -- start 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.045+0000 7f37d38e96c0 1 -- start start 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d38e96c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f37cc10be60 0x7f37cc0f5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d38e96c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f37cc112070 0x7f37cc172910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d0e596c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f37cc112070 0x7f37cc172910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d165a6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f37cc10be60 0x7f37cc0f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d0e596c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f37cc112070 0x7f37cc172910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33754/0 (socket says 10.20.193.70:33754) 2026-02-13T03:45:34.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d0e596c0 1 -- 10.20.193.70:0/2718817872 learned_addr learned my addr 10.20.193.70:0/2718817872 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.054 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f78dd7fa6c0 1 -- 10.20.193.70:0/2192878238 <== mon.2 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f78cc0071c0 con 0x7f78e00607a0 2026-02-13T03:45:34.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d38e96c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37cc0f6390 0x7f37cc0fb660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc0f6a80 con 0x7f37cc112070 2026-02-13T03:45:34.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc0fbba0 con 0x7f37cc0f6390 2026-02-13T03:45:34.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc0fbd60 con 0x7f37cc10be60 2026-02-13T03:45:34.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d1e5b6c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37cc0f6390 0x7f37cc0fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d0e596c0 1 -- 10.20.193.70:0/2718817872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f37cc10be60 msgr2=0x7f37cc0f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d0e596c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f37cc10be60 0x7f37cc0f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d0e596c0 1 -- 10.20.193.70:0/2718817872 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37cc0f6390 msgr2=0x7f37cc0fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.046+0000 7f37d0e596c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f37cc0f6390 0x7f37cc0fb660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f37d0e596c0 1 -- 10.20.193.70:0/2718817872 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c800a660 con 0x7f37cc112070 2026-02-13T03:45:34.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f37d165a6c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f37cc10be60 0x7f37cc0f5d60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:45:34.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f37d0e596c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f37cc112070 0x7f37cc172910 secure :-1 s=READY pgs=264 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c000b9b0 tx=0x7f37c000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f78dd7fa6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78b40be120 0x7f78b40de5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f37ba7fc6c0 1 -- 10.20.193.70:0/2718817872 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37c0004a80 con 0x7f37cc112070 2026-02-13T03:45:34.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f37ba7fc6c0 1 -- 10.20.193.70:0/2718817872 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f37c0009030 con 0x7f37cc112070 2026-02-13T03:45:34.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37bc00b750 con 0x7f37cc112070 2026-02-13T03:45:34.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f78df7fe6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78b40be120 0x7f78b40de5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f78dd7fa6c0 1 -- 10.20.193.70:0/2192878238 <== mon.2 v2:10.20.193.127:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f78cc107da0 con 0x7f78e00607a0 2026-02-13T03:45:34.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f78dd7fa6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] conn(0x7f78b40e5700 0x7f78b4105b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f78dd7fa6c0 1 -- 10.20.193.70:0/2192878238 --> [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78b41061c0 con 0x7f78b40e5700 2026-02-13T03:45:34.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f78dd7fa6c0 1 -- 10.20.193.70:0/2192878238 <== mon.2 v2:10.20.193.127:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f78cc1080d0 con 0x7f78e00607a0 2026-02-13T03:45:34.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f78df7fe6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78b40be120 0x7f78b40de5d0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e0167e50 tx=0x7f78d0009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f78e4f5a6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] conn(0x7f78b40e5700 0x7f78b4105b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f78e4f5a6c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] conn(0x7f78b40e5700 0x7f78b4105b10 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.049+0000 7f78dd7fa6c0 1 -- 10.20.193.70:0/2192878238 <== osd.4 v2:10.20.193.127:6808/2954348410 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f78b41061c0 con 0x7f78b40e5700 2026-02-13T03:45:34.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f37ba7fc6c0 1 -- 10.20.193.70:0/2718817872 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37c000cd70 con 0x7f37cc112070 2026-02-13T03:45:34.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f91b110d6c0 1 -- 10.20.193.70:0/2001364859 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91ac10f230 msgr2=0x7f91ac10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f91b110d6c0 1 --2- 10.20.193.70:0/2001364859 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91ac10f230 0x7f91ac10f600 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=2578741213135141463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91a00099a0 tx=0x7f91a002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f91b110d6c0 1 -- 10.20.193.70:0/2001364859 shutdown_connections 2026-02-13T03:45:34.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f91b110d6c0 1 --2- 10.20.193.70:0/2001364859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91ac115440 0x7f91ac175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f91b110d6c0 1 --2- 10.20.193.70:0/2001364859 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91ac10fc20 0x7f91ac114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f91b110d6c0 1 --2- 10.20.193.70:0/2001364859 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91ac10f230 0x7f91ac10f600 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=2578741213135141463 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f91b110d6c0 1 -- 10.20.193.70:0/2001364859 >> 10.20.193.70:0/2001364859 conn(0x7f91ac0ecb30 msgr2=0x7f91ac10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f91b110d6c0 1 -- 10.20.193.70:0/2001364859 shutdown_connections 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.047+0000 7f91b110d6c0 1 -- 10.20.193.70:0/2001364859 wait complete. 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91b110d6c0 1 Processor -- start 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91b110d6c0 1 -- start start 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91b110d6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91ac10f230 0x7f91ac11d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91b110d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91ac115440 0x7f91ac11d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91b110d6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91ac122cb0 0x7f91ac123150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91b110d6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac1236c0 con 0x7f91ac115440 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91b110d6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac123830 con 0x7f91ac122cb0 2026-02-13T03:45:34.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91b110d6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac1239f0 con 0x7f91ac10f230 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91aa5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91ac115440 0x7f91ac11d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91aa5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91ac115440 0x7f91ac11d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33760/0 (socket says 10.20.193.70:33760) 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91aa5756c0 1 -- 10.20.193.70:0/3823449493 learned_addr learned my addr 10.20.193.70:0/3823449493 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91ab5776c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91ac122cb0 0x7f91ac123150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91aad766c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91ac10f230 0x7f91ac11d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91aa5756c0 1 -- 10.20.193.70:0/3823449493 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91ac10f230 msgr2=0x7f91ac11d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91aa5756c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91ac10f230 0x7f91ac11d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91aa5756c0 1 -- 10.20.193.70:0/3823449493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91ac122cb0 msgr2=0x7f91ac123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91aa5756c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f91ac122cb0 0x7f91ac123150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.048+0000 7f91aa5756c0 1 -- 10.20.193.70:0/3823449493 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a0009590 con 0x7f91ac115440 2026-02-13T03:45:34.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.049+0000 7f91aa5756c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91ac115440 0x7f91ac11d8f0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f919400b800 tx=0x7f919400bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.049+0000 7f918bfff6c0 1 -- 10.20.193.70:0/3823449493 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9194004a80 con 0x7f91ac115440 2026-02-13T03:45:34.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.049+0000 7f918bfff6c0 1 -- 10.20.193.70:0/3823449493 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9194009070 con 0x7f91ac115440 2026-02-13T03:45:34.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.049+0000 7f918bfff6c0 1 -- 10.20.193.70:0/3823449493 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f919400cdd0 con 0x7f91ac115440 2026-02-13T03:45:34.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.049+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac0628d0 con 0x7f91ac115440 2026-02-13T03:45:34.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.049+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ac062d60 con 0x7f91ac115440 2026-02-13T03:45:34.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.050+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91ac052a50 con 0x7f91ac115440 2026-02-13T03:45:34.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.050+0000 7f37ba7fc6c0 1 -- 10.20.193.70:0/2718817872 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f37c00071c0 con 0x7f37cc112070 2026-02-13T03:45:34.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.051+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37cc0fc330 con 0x7f37cc112070 2026-02-13T03:45:34.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.051+0000 7f37ba7fc6c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37a80b5710 0x7f37a80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.051+0000 7f37ba7fc6c0 1 -- 10.20.193.70:0/2718817872 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f37c0005020 con 0x7f37cc112070 2026-02-13T03:45:34.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.051+0000 7f37d165a6c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37a80b5710 0x7f37a80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.052+0000 7f918bfff6c0 1 -- 10.20.193.70:0/3823449493 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f9194004070 con 0x7f91ac115440 2026-02-13T03:45:34.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.052+0000 7f37d38e96c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] conn(0x7f37cc174af0 0x7f37cc04cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.052+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 --> [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37cc10d130 con 0x7f37cc174af0 2026-02-13T03:45:34.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.052+0000 7f37d1e5b6c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] conn(0x7f37cc174af0 0x7f37cc04cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.052+0000 7f37d165a6c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37a80b5710 0x7f37a80d5bc0 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37bc004830 tx=0x7f37bc0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.052+0000 7f37d1e5b6c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] conn(0x7f37cc174af0 0x7f37cc04cf30 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.052+0000 7f918bfff6c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91800b5710 0x7f91800d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.053+0000 7f91aad766c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91800b5710 0x7f91800d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.053+0000 7f918bfff6c0 1 -- 10.20.193.70:0/3823449493 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f91940e3aa0 con 0x7f91ac115440 2026-02-13T03:45:34.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.053+0000 7f918bfff6c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] conn(0x7f91800dccf0 0x7f91800fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.053+0000 7f918bfff6c0 1 -- 10.20.193.70:0/3823449493 --> [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91800fd7b0 con 0x7f91800dccf0 2026-02-13T03:45:34.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.053+0000 7f918bfff6c0 1 -- 10.20.193.70:0/3823449493 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f91940e3e50 con 0x7f91ac115440 2026-02-13T03:45:34.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.053+0000 7f91aad766c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91800b5710 0x7f91800d5bc0 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91a00023e0 tx=0x7f91a0005ca0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.069 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.053+0000 7f37ba7fc6c0 1 -- 10.20.193.70:0/2718817872 <== osd.5 v2:10.20.193.177:6808/2878984246 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f37cc10d130 con 0x7f37cc174af0 2026-02-13T03:45:34.069 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.053+0000 7f91ab5776c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] conn(0x7f91800dccf0 0x7f91800fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.053+0000 7f91ab5776c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] conn(0x7f91800dccf0 0x7f91800fd100 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.054+0000 7f918bfff6c0 1 -- 10.20.193.70:0/3823449493 <== osd.8 v2:10.20.193.177:6816/2623744285 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f91800fd7b0 con 0x7f91800dccf0 2026-02-13T03:45:34.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 --> [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f78e015a540 con 0x7f78b40e5700 2026-02-13T03:45:34.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78dd7fa6c0 1 -- 10.20.193.70:0/2192878238 <== osd.4 v2:10.20.193.127:6808/2954348410 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f78e015a540 con 0x7f78b40e5700 2026-02-13T03:45:34.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 >> [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] conn(0x7f78b40e5700 msgr2=0x7f78b4105b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.127:6808/2954348410,v1:10.20.193.127:6809/2954348410] conn(0x7f78b40e5700 0x7f78b4105b10 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78b40be120 msgr2=0x7f78b40de5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78b40be120 0x7f78b40de5d0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78e0167e50 tx=0x7f78d0009390 comp rx=0 tx=0).stop 2026-02-13T03:45:34.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78e00607a0 msgr2=0x7f78e01614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 --2- 10.20.193.70:0/2192878238 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f78e00607a0 0x7f78e01614c0 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78cc0023e0 tx=0x7f78cc02fc80 comp rx=0 tx=0).stop 2026-02-13T03:45:34.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e4f5a6c0 1 -- 10.20.193.70:0/2192878238 reap_dead start 2026-02-13T03:45:34.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 shutdown_connections 2026-02-13T03:45:34.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 >> 10.20.193.70:0/2192878238 conn(0x7f78e00ea8b0 msgr2=0x7f78e010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.057+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 shutdown_connections 2026-02-13T03:45:34.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.058+0000 7f78e69e46c0 1 -- 10.20.193.70:0/2192878238 wait complete. 2026-02-13T03:45:34.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.062+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 --> [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37cc04d770 con 0x7f37cc174af0 2026-02-13T03:45:34.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.062+0000 7f37ba7fc6c0 1 -- 10.20.193.70:0/2718817872 <== osd.5 v2:10.20.193.177:6808/2878984246 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f37cc04d770 con 0x7f37cc174af0 2026-02-13T03:45:34.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 >> [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] conn(0x7f37cc174af0 msgr2=0x7f37cc04cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.177:6808/2878984246,v1:10.20.193.177:6809/2878984246] conn(0x7f37cc174af0 0x7f37cc04cf30 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 --> [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91ac179340 con 0x7f91800dccf0 2026-02-13T03:45:34.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37a80b5710 msgr2=0x7f37a80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37a80b5710 0x7f37a80d5bc0 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37bc004830 tx=0x7f37bc0023a0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f37cc112070 msgr2=0x7f37cc172910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 --2- 10.20.193.70:0/2718817872 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f37cc112070 0x7f37cc172910 secure :-1 s=READY pgs=264 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c000b9b0 tx=0x7f37c000be80 comp rx=0 tx=0).stop 2026-02-13T03:45:34.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d1e5b6c0 1 -- 10.20.193.70:0/2718817872 reap_dead start 2026-02-13T03:45:34.076 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f918bfff6c0 1 -- 10.20.193.70:0/3823449493 <== osd.8 v2:10.20.193.177:6816/2623744285 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f91ac179340 con 0x7f91800dccf0 2026-02-13T03:45:34.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 shutdown_connections 2026-02-13T03:45:34.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 >> 10.20.193.70:0/2718817872 conn(0x7f37cc0e9740 msgr2=0x7f37cc10dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 shutdown_connections 2026-02-13T03:45:34.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f37d38e96c0 1 -- 10.20.193.70:0/2718817872 wait complete. 2026-02-13T03:45:34.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 >> [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] conn(0x7f91800dccf0 msgr2=0x7f91800fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.063+0000 7f91b110d6c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.177:6816/2623744285,v1:10.20.193.177:6817/2623744285] conn(0x7f91800dccf0 0x7f91800fd100 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.064+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91800b5710 msgr2=0x7f91800d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.064+0000 7f91b110d6c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f91800b5710 0x7f91800d5bc0 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91a00023e0 tx=0x7f91a0005ca0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.064+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91ac115440 msgr2=0x7f91ac11d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.064+0000 7f91b110d6c0 1 --2- 10.20.193.70:0/3823449493 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f91ac115440 0x7f91ac11d8f0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f919400b800 tx=0x7f919400bcd0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 -- 10.20.193.70:0/2518922756 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4e6c10fc20 msgr2=0x7f4e6c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 --2- 10.20.193.70:0/2518922756 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4e6c10fc20 0x7f4e6c114c60 secure :-1 s=READY pgs=267 gs=2 cs=0 l=1 c_cookie=3896074549805440924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e5c0098d0 tx=0x7f4e5c02ec40 comp rx=0 tx=0).stop 2026-02-13T03:45:34.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 -- 10.20.193.70:0/2518922756 shutdown_connections 2026-02-13T03:45:34.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 --2- 10.20.193.70:0/2518922756 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4e6c115440 0x7f4e6c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 --2- 10.20.193.70:0/2518922756 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4e6c10fc20 0x7f4e6c114c60 unknown :-1 s=CLOSED pgs=267 gs=2 cs=0 l=1 c_cookie=3896074549805440924 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 --2- 10.20.193.70:0/2518922756 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4e6c10f230 0x7f4e6c10f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 -- 10.20.193.70:0/2518922756 >> 10.20.193.70:0/2518922756 conn(0x7f4e6c0ecb30 msgr2=0x7f4e6c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 -- 10.20.193.70:0/2518922756 shutdown_connections 2026-02-13T03:45:34.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 -- 10.20.193.70:0/2518922756 wait complete. 2026-02-13T03:45:34.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 Processor -- start 2026-02-13T03:45:34.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f4e724236c0 1 -- start start 2026-02-13T03:45:34.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.064+0000 7fac6ee776c0 1 -- 10.20.193.70:0/2889063044 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fac6810fc20 msgr2=0x7fac68114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.064+0000 7fac6ee776c0 1 --2- 10.20.193.70:0/2889063044 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fac6810fc20 0x7fac68114c60 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=8490624869689699923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac500099a0 tx=0x7fac5002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7fac6ee776c0 1 -- 10.20.193.70:0/2889063044 shutdown_connections 2026-02-13T03:45:34.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7fac6ee776c0 1 --2- 10.20.193.70:0/2889063044 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac68115440 0x7fac68175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7fac6ee776c0 1 --2- 10.20.193.70:0/2889063044 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fac6810fc20 0x7fac68114c60 unknown :-1 s=CLOSED pgs=266 gs=1 cs=0 l=1 c_cookie=8490624869689699923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7fac6ee776c0 1 --2- 10.20.193.70:0/2889063044 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fac6810f230 0x7fac6810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7fac6ee776c0 1 -- 10.20.193.70:0/2889063044 >> 10.20.193.70:0/2889063044 conn(0x7fac680ecb30 msgr2=0x7fac6810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e724236c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4e6c10f230 0x7f4e6c05cc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7fac6ee776c0 1 -- 10.20.193.70:0/2889063044 shutdown_connections 2026-02-13T03:45:34.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7fac6ee776c0 1 -- 10.20.193.70:0/2889063044 wait complete. 2026-02-13T03:45:34.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7fac6ee776c0 1 Processor -- start 2026-02-13T03:45:34.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7fac6ee776c0 1 -- start start 2026-02-13T03:45:34.083 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e724236c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4e6c115440 0x7f4e6c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.083 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6ee776c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fac6810f230 0x7fac680f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e724236c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4e6c05d1b0 0x7f4e6c05d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e6b7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4e6c115440 0x7f4e6c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6ee776c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fac68115440 0x7fac68175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6ee776c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac680f5270 0x7fac680fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6ee776c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fac680f5960 con 0x7fac6810f230 2026-02-13T03:45:34.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6ee776c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fac680faa80 con 0x7fac68115440 2026-02-13T03:45:34.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6ee776c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fac680fac40 con 0x7fac680f5270 2026-02-13T03:45:34.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e6b7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4e6c115440 0x7f4e6c175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33796/0 (socket says 10.20.193.70:33796) 2026-02-13T03:45:34.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e6bfff6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4e6c10f230 0x7f4e6c05cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e724236c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c103440 con 0x7f4e6c115440 2026-02-13T03:45:34.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e724236c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c1035b0 con 0x7f4e6c05d1b0 2026-02-13T03:45:34.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e724236c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c103770 con 0x7f4e6c10f230 2026-02-13T03:45:34.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e6b7fe6c0 1 -- 10.20.193.70:0/1164142107 learned_addr learned my addr 10.20.193.70:0/1164142107 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6cbe86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fac6810f230 0x7fac680f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e709956c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4e6c05d1b0 0x7f4e6c05d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6cbe86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fac6810f230 0x7fac680f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33812/0 (socket says 10.20.193.70:33812) 2026-02-13T03:45:34.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6cbe86c0 1 -- 10.20.193.70:0/1914964683 learned_addr learned my addr 10.20.193.70:0/1914964683 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6d3e96c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac680f5270 0x7fac680fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.064+0000 7f91ab5776c0 1 -- 10.20.193.70:0/3823449493 reap_dead start 2026-02-13T03:45:34.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 shutdown_connections 2026-02-13T03:45:34.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 >> 10.20.193.70:0/3823449493 conn(0x7f91ac0ecb30 msgr2=0x7f91ac10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 shutdown_connections 2026-02-13T03:45:34.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.065+0000 7f91b110d6c0 1 -- 10.20.193.70:0/3823449493 wait complete. 2026-02-13T03:45:34.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6cbe86c0 1 -- 10.20.193.70:0/1914964683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac680f5270 msgr2=0x7fac680fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6cbe86c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac680f5270 0x7fac680fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6cbe86c0 1 -- 10.20.193.70:0/1914964683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fac68115440 msgr2=0x7fac68175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6cbe86c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fac68115440 0x7fac68175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6cbe86c0 1 -- 10.20.193.70:0/1914964683 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac50009590 con 0x7fac6810f230 2026-02-13T03:45:34.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e6b7fe6c0 1 -- 10.20.193.70:0/1164142107 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4e6c10f230 msgr2=0x7f4e6c05cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e6b7fe6c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4e6c10f230 0x7f4e6c05cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6cbe86c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fac6810f230 0x7fac680f4c40 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5800b710 tx=0x7fac5800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e6b7fe6c0 1 -- 10.20.193.70:0/1164142107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4e6c05d1b0 msgr2=0x7f4e6c05d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e6b7fe6c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f4e6c05d1b0 0x7f4e6c05d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7f4e6b7fe6c0 1 -- 10.20.193.70:0/1164142107 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5c0094c0 con 0x7f4e6c115440 2026-02-13T03:45:34.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.067+0000 7f4e6b7fe6c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4e6c115440 0x7f4e6c175ce0 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e5c005980 tx=0x7f4e5c02fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac5dffb6c0 1 -- 10.20.193.70:0/1914964683 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac58004250 con 0x7fac6810f230 2026-02-13T03:45:34.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac5dffb6c0 1 -- 10.20.193.70:0/1914964683 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fac58002d80 con 0x7fac6810f230 2026-02-13T03:45:34.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.066+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac680faf20 con 0x7fac6810f230 2026-02-13T03:45:34.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.067+0000 7fac5dffb6c0 1 -- 10.20.193.70:0/1914964683 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5800ce50 con 0x7fac6810f230 2026-02-13T03:45:34.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.067+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac680fb6b0 con 0x7fac6810f230 2026-02-13T03:45:34.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.067+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac68052a50 con 0x7fac6810f230 2026-02-13T03:45:34.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.067+0000 7f4e697fa6c0 1 -- 10.20.193.70:0/1164142107 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e5c002ae0 con 0x7f4e6c115440 2026-02-13T03:45:34.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.067+0000 7f4e697fa6c0 1 -- 10.20.193.70:0/1164142107 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4e5c005d50 con 0x7f4e6c115440 2026-02-13T03:45:34.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.067+0000 7f4e697fa6c0 1 -- 10.20.193.70:0/1164142107 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e5c002ae0 con 0x7f4e6c115440 2026-02-13T03:45:34.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.067+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c1039f0 con 0x7f4e6c115440 2026-02-13T03:45:34.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.067+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c103e20 con 0x7f4e6c115440 2026-02-13T03:45:34.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.068+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e6c052a50 con 0x7f4e6c115440 2026-02-13T03:45:34.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.069+0000 7fac5dffb6c0 1 -- 10.20.193.70:0/1914964683 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fac580043b0 con 0x7fac6810f230 2026-02-13T03:45:34.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.070+0000 7f4e697fa6c0 1 -- 10.20.193.70:0/1164142107 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f4e5c002c40 con 0x7f4e6c115440 2026-02-13T03:45:34.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.070+0000 7fac5dffb6c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fac440b5780 0x7fac440d5c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.070+0000 7fac5ffff6c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fac440b5780 0x7fac440d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.070+0000 7fac5dffb6c0 1 -- 10.20.193.70:0/1914964683 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fac580e3a70 con 0x7fac6810f230 2026-02-13T03:45:34.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.070+0000 7fac5dffb6c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] conn(0x7fac440dcd60 0x7fac440fd170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.070+0000 7fac5dffb6c0 1 -- 10.20.193.70:0/1914964683 --> [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac440fd820 con 0x7fac440dcd60 2026-02-13T03:45:34.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.070+0000 7fac5dffb6c0 1 -- 10.20.193.70:0/1914964683 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fac580e3da0 con 0x7fac6810f230 2026-02-13T03:45:34.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7fac6d3e96c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] conn(0x7fac440dcd60 0x7fac440fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7fac5ffff6c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fac440b5780 0x7fac440d5c30 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac680fb5d0 tx=0x7fac50005bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.094 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7f4e697fa6c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4e400b5740 0x7f4e400d5bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.094 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7fac6d3e96c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] conn(0x7fac440dcd60 0x7fac440fd170 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.094 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7f4e697fa6c0 1 -- 10.20.193.70:0/1164142107 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f4e5c107660 con 0x7f4e6c115440 2026-02-13T03:45:34.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7f4e697fa6c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] conn(0x7f4e400dcd10 0x7f4e400fd120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7f4e697fa6c0 1 -- 10.20.193.70:0/1164142107 --> [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e400fd7d0 con 0x7f4e400dcd10 2026-02-13T03:45:34.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7f4e697fa6c0 1 -- 10.20.193.70:0/1164142107 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f4e5c002ae0 con 0x7f4e6c115440 2026-02-13T03:45:34.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7f4e6bfff6c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4e400b5740 0x7f4e400d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7f4e709956c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] conn(0x7f4e400dcd10 0x7f4e400fd120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.071+0000 7f4e6bfff6c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4e400b5740 0x7f4e400d5bf0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e58005b40 tx=0x7f4e58009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.072+0000 7fac5dffb6c0 1 -- 10.20.193.70:0/1914964683 <== osd.2 v2:10.20.193.177:6800/2599066943 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fac440fd820 con 0x7fac440dcd60 2026-02-13T03:45:34.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.072+0000 7f4e709956c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] conn(0x7f4e400dcd10 0x7f4e400fd120 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.072+0000 7f4e697fa6c0 1 -- 10.20.193.70:0/1164142107 <== osd.1 v2:10.20.193.127:6800/3454251527 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f4e400fd7d0 con 0x7f4e400dcd10 2026-02-13T03:45:34.096 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.074+0000 7f8344cb86c0 1 -- 10.20.193.70:0/2129344910 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8340115440 msgr2=0x7f8340175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.096 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.074+0000 7f8344cb86c0 1 --2- 10.20.193.70:0/2129344910 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8340115440 0x7f8340175de0 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=3944620936458931774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f833000a9b0 tx=0x7f833002fd20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.074+0000 7f8344cb86c0 1 -- 10.20.193.70:0/2129344910 shutdown_connections 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.074+0000 7f8344cb86c0 1 --2- 10.20.193.70:0/2129344910 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8340115440 0x7f8340175de0 unknown :-1 s=CLOSED pgs=270 gs=1 cs=0 l=1 c_cookie=3944620936458931774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.074+0000 7f8344cb86c0 1 --2- 10.20.193.70:0/2129344910 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f834010fc20 0x7f8340114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.074+0000 7f8344cb86c0 1 --2- 10.20.193.70:0/2129344910 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f834010f230 0x7f834010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.074+0000 7f8344cb86c0 1 -- 10.20.193.70:0/2129344910 >> 10.20.193.70:0/2129344910 conn(0x7f83400ecb30 msgr2=0x7f834010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.074+0000 7f8344cb86c0 1 -- 10.20.193.70:0/2129344910 shutdown_connections 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.074+0000 7f8344cb86c0 1 -- 10.20.193.70:0/2129344910 wait complete. 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 Processor -- start 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 -- start start 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f834010f230 0x7f834011d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8340115440 0x7f834011d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8340122af0 0x7f8340122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8340123500 con 0x7f8340115440 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f8340123670 con 0x7f8340122af0 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8340123830 con 0x7f834010f230 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833dd746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8340115440 0x7f834011d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833dd746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8340115440 0x7f834011d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33842/0 (socket says 10.20.193.70:33842) 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833dd746c0 1 -- 10.20.193.70:0/3211919951 learned_addr learned my addr 10.20.193.70:0/3211919951 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833e5756c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f834010f230 0x7f834011d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833ed766c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8340122af0 0x7f8340122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833dd746c0 1 -- 10.20.193.70:0/3211919951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f834010f230 msgr2=0x7f834011d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833dd746c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f834010f230 0x7f834011d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833dd746c0 1 -- 10.20.193.70:0/3211919951 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8340122af0 msgr2=0x7f8340122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833dd746c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f8340122af0 0x7f8340122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833dd746c0 1 -- 10.20.193.70:0/3211919951 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833000a5b0 con 0x7f8340115440 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f833dd746c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8340115440 0x7f834011d730 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8328005dc0 tx=0x7f832800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f83277fe6c0 1 -- 10.20.193.70:0/3211919951 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8328004250 con 0x7f8340115440 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8340163ce0 con 0x7f8340115440 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f83277fe6c0 1 -- 10.20.193.70:0/3211919951 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8328009070 con 0x7f8340115440 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83401641c0 con 0x7f8340115440 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.075+0000 7f83277fe6c0 1 -- 10.20.193.70:0/3211919951 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f832800cca0 con 0x7f8340115440 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.076+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8340052a50 con 0x7f8340115440 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.078+0000 7f83277fe6c0 1 -- 10.20.193.70:0/3211919951 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f83280028c0 con 0x7f8340115440 2026-02-13T03:45:34.098 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.078+0000 7f83277fe6c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83180b5710 0x7f83180d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.078+0000 7f83277fe6c0 1 -- 10.20.193.70:0/3211919951 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f83280e3c40 con 0x7f8340115440 2026-02-13T03:45:34.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.079+0000 7f83277fe6c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] conn(0x7f83180dccf0 0x7f83180fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.079+0000 7f83277fe6c0 1 -- 10.20.193.70:0/3211919951 --> [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83180fd7b0 con 0x7f83180dccf0 2026-02-13T03:45:34.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.079+0000 7f83277fe6c0 1 -- 10.20.193.70:0/3211919951 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f83280e3f70 con 0x7f8340115440 2026-02-13T03:45:34.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.079+0000 7f833e5756c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83180b5710 0x7f83180d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.079+0000 7f833ed766c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] conn(0x7f83180dccf0 0x7f83180fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.079+0000 7f833e5756c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83180b5710 0x7f83180d5bc0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8334005b40 tx=0x7f8334009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.079+0000 7f833ed766c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] conn(0x7f83180dccf0 0x7f83180fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f83277fe6c0 1 -- 10.20.193.70:0/3211919951 <== osd.3 v2:10.20.193.70:6810/3715748086 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f83180fd7b0 con 0x7f83180dccf0 2026-02-13T03:45:34.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f86c99d06c0 1 -- 10.20.193.70:0/2987846958 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f86c410d9a0 msgr2=0x7f86c41129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f86c99d06c0 1 --2- 10.20.193.70:0/2987846958 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f86c410d9a0 0x7f86c41129e0 secure :-1 s=READY pgs=272 gs=2 cs=0 l=1 c_cookie=4947792564192336125 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86ac0099a0 tx=0x7f86ac02ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f86c99d06c0 1 -- 10.20.193.70:0/2987846958 shutdown_connections 2026-02-13T03:45:34.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f86c99d06c0 1 --2- 10.20.193.70:0/2987846958 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c41131c0 0x7f86c4173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f86c99d06c0 1 --2- 10.20.193.70:0/2987846958 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f86c410d9a0 0x7f86c41129e0 unknown :-1 s=CLOSED pgs=272 gs=2 cs=0 l=1 c_cookie=4947792564192336125 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f86c99d06c0 1 --2- 10.20.193.70:0/2987846958 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c410cfb0 0x7f86c410d380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f86c99d06c0 1 -- 10.20.193.70:0/2987846958 >> 10.20.193.70:0/2987846958 conn(0x7f86c40ea8b0 msgr2=0x7f86c410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f86c99d06c0 1 -- 10.20.193.70:0/2987846958 shutdown_connections 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.080+0000 7f86c99d06c0 1 -- 10.20.193.70:0/2987846958 wait complete. 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c99d06c0 1 Processor -- start 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c99d06c0 1 -- start start 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c99d06c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c410cfb0 0x7f86c40f2980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c99d06c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f86c41131c0 0x7f86c4173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c99d06c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c40f2fb0 0x7f86c40f8280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c99d06c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86c40f36a0 con 0x7f86c41131c0 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c99d06c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f86c40f87c0 con 0x7f86c410cfb0 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c99d06c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f86c40f8980 con 0x7f86c40f2fb0 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c27fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f86c41131c0 0x7f86c4173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c27fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f86c41131c0 0x7f86c4173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33860/0 (socket says 10.20.193.70:33860) 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c27fc6c0 1 -- 10.20.193.70:0/696208478 learned_addr learned my addr 10.20.193.70:0/696208478 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7f86c37fe6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c40f2fb0 0x7f86c40f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c2ffd6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c410cfb0 0x7f86c40f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.081+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 --> [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac681792a0 con 0x7fac440dcd60 2026-02-13T03:45:34.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c27fc6c0 1 -- 10.20.193.70:0/696208478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c40f2fb0 msgr2=0x7f86c40f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c27fc6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c40f2fb0 0x7f86c40f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c27fc6c0 1 -- 10.20.193.70:0/696208478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c410cfb0 msgr2=0x7f86c40f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c27fc6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f86c410cfb0 0x7f86c40f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c27fc6c0 1 -- 10.20.193.70:0/696208478 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b80094c0 con 0x7f86c41131c0 2026-02-13T03:45:34.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c27fc6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f86c41131c0 0x7f86c4173a60 secure :-1 s=READY pgs=273 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86ac02f230 tx=0x7f86ac02fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.102 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7fac5dffb6c0 1 -- 10.20.193.70:0/1914964683 <== osd.2 v2:10.20.193.177:6800/2599066943 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac681792a0 con 0x7fac440dcd60 2026-02-13T03:45:34.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c89ce6c0 1 -- 10.20.193.70:0/696208478 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86ac002ae0 con 0x7f86c41131c0 2026-02-13T03:45:34.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c89ce6c0 1 -- 10.20.193.70:0/696208478 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f86ac002c40 con 0x7f86c41131c0 2026-02-13T03:45:34.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ac009590 con 0x7f86c41131c0 2026-02-13T03:45:34.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c40f8f40 con 0x7f86c41131c0 2026-02-13T03:45:34.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c89ce6c0 1 -- 10.20.193.70:0/696208478 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86ac037070 con 0x7f86c41131c0 2026-02-13T03:45:34.103 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.082+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86c4052a50 con 0x7f86c41131c0 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.083+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 >> [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] conn(0x7fac440dcd60 msgr2=0x7fac440fd170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.083+0000 7fac6ee776c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.177:6800/2599066943,v1:10.20.193.177:6801/2599066943] conn(0x7fac440dcd60 0x7fac440fd170 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.083+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fac440b5780 msgr2=0x7fac440d5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.083+0000 7fac6ee776c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fac440b5780 0x7fac440d5c30 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac680fb5d0 tx=0x7fac50005bc0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.083+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fac6810f230 msgr2=0x7fac680f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.083+0000 7fac6ee776c0 1 --2- 10.20.193.70:0/1914964683 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fac6810f230 0x7fac680f4c40 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5800b710 tx=0x7fac5800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.083+0000 7fac6d3e96c0 1 -- 10.20.193.70:0/1914964683 reap_dead start 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 shutdown_connections 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 >> 10.20.193.70:0/1914964683 conn(0x7fac680ecb30 msgr2=0x7fac6810d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 shutdown_connections 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fac6ee776c0 1 -- 10.20.193.70:0/1914964683 wait complete. 2026-02-13T03:45:34.104 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7f86c89ce6c0 1 -- 10.20.193.70:0/696208478 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f86ac0071c0 con 0x7f86c41131c0 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1113555625 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe16c10d980 msgr2=0x7fe16c1129c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fe1744b36c0 1 --2- 10.20.193.70:0/1113555625 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe16c10d980 0x7fe16c1129c0 secure :-1 s=READY pgs=51 gs=3 cs=0 l=1 c_cookie=16164560939209671144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe160009970 tx=0x7fe16002ed50 comp rx=0 tx=0).stop 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1113555625 shutdown_connections 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fe1744b36c0 1 --2- 10.20.193.70:0/1113555625 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe16c1131a0 0x7fe16c173b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fe1744b36c0 1 --2- 10.20.193.70:0/1113555625 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe16c10d980 0x7fe16c1129c0 unknown :-1 s=CLOSED pgs=51 gs=3 cs=0 l=1 c_cookie=16164560939209671144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fe1744b36c0 1 --2- 10.20.193.70:0/1113555625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe16c10cf90 0x7fe16c10d360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1113555625 >> 10.20.193.70:0/1113555625 conn(0x7fe16c0ea8b0 msgr2=0x7fe16c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.084+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1113555625 shutdown_connections 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1113555625 wait complete. 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 --> [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e6c179310 con 0x7f4e400dcd10 2026-02-13T03:45:34.105 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f4e697fa6c0 1 -- 10.20.193.70:0/1164142107 <== osd.1 v2:10.20.193.127:6800/3454251527 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4e6c179310 con 0x7f4e400dcd10 2026-02-13T03:45:34.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1744b36c0 1 Processor -- start 2026-02-13T03:45:34.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1744b36c0 1 -- start start 2026-02-13T03:45:34.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 >> [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] conn(0x7f4e400dcd10 msgr2=0x7f4e400fd120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f4e724236c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.127:6800/3454251527,v1:10.20.193.127:6801/3454251527] conn(0x7f4e400dcd10 0x7f4e400fd120 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f86c89ce6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f86980b5790 0x7f86980d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1744b36c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe16c10cf90 0x7fe16c0f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1744b36c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe16c1131a0 0x7fe16c173a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe171a236c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe16c1131a0 0x7fe16c173a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe171a236c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe16c1131a0 0x7fe16c173a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33884/0 (socket says 10.20.193.70:33884) 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1722246c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe16c10cf90 0x7fe16c0f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1722246c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe16c10cf90 0x7fe16c0f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:56892/0 (socket says 10.20.193.70:56892) 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1744b36c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe16c0f51f0 0x7fe16c0fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe171a236c0 1 -- 10.20.193.70:0/1022495928 learned_addr learned my addr 10.20.193.70:0/1022495928 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1022495928 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0f5850 con 0x7fe16c1131a0 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1022495928 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0faa00 con 0x7fe16c10cf90 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1022495928 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0fabc0 con 0x7fe16c0f51f0 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4e400b5740 msgr2=0x7f4e400d5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f4e724236c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f4e400b5740 0x7f4e400d5bf0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e58005b40 tx=0x7f4e58009310 comp rx=0 tx=0).stop 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4e6c115440 msgr2=0x7f4e6c175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f4e724236c0 1 --2- 10.20.193.70:0/1164142107 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f4e6c115440 0x7f4e6c175ce0 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e5c005980 tx=0x7f4e5c02fb20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f4e709956c0 1 -- 10.20.193.70:0/1164142107 reap_dead start 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe172a256c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe16c0f51f0 0x7fe16c0fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1722246c0 1 -- 10.20.193.70:0/1022495928 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe16c0f51f0 msgr2=0x7fe16c0fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1722246c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe16c0f51f0 0x7fe16c0fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1722246c0 1 -- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe16c1131a0 msgr2=0x7fe16c173a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1722246c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe16c1131a0 0x7fe16c173a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1722246c0 1 -- 10.20.193.70:0/1022495928 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe160009590 con 0x7fe16c10cf90 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe171a236c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe16c1131a0 0x7fe16c173a40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f86c89ce6c0 1 -- 10.20.193.70:0/696208478 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f86ac107af0 con 0x7f86c41131c0 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f86c2ffd6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f86980b5790 0x7f86980d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f86c89ce6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] conn(0x7f86980dcd70 0x7f86980fd180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f86c89ce6c0 1 -- 10.20.193.70:0/696208478 --> [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86980fd830 con 0x7f86980dcd70 2026-02-13T03:45:34.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.085+0000 7f86c89ce6c0 1 -- 10.20.193.70:0/696208478 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f86ac107e20 con 0x7f86c41131c0 2026-02-13T03:45:34.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1722246c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe16c10cf90 0x7fe16c0f4bc0 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c00b6c0 tx=0x7fe15c00bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f86c37fe6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] conn(0x7f86980dcd70 0x7f86980fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f86c2ffd6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f86980b5790 0x7f86980d5c40 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b8004750 tx=0x7f86b8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f86c37fe6c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] conn(0x7f86980dcd70 0x7f86980fd180 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1537fe6c0 1 -- 10.20.193.70:0/1022495928 <== mon.2 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe15c004240 con 0x7fe16c10cf90 2026-02-13T03:45:34.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 shutdown_connections 2026-02-13T03:45:34.110 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 >> 10.20.193.70:0/1164142107 conn(0x7f4e6c0ecb30 msgr2=0x7f4e6c10d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.110 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1537fe6c0 1 -- 10.20.193.70:0/1022495928 <== mon.2 v2:10.20.193.127:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe15c009030 con 0x7fe16c10cf90 2026-02-13T03:45:34.110 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1022495928 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c0fae40 con 0x7fe16c10cf90 2026-02-13T03:45:34.110 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1537fe6c0 1 -- 10.20.193.70:0/1022495928 <== mon.2 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe15c0036e0 con 0x7fe16c10cf90 2026-02-13T03:45:34.110 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 shutdown_connections 2026-02-13T03:45:34.110 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7f4e724236c0 1 -- 10.20.193.70:0/1164142107 wait complete. 2026-02-13T03:45:34.110 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.086+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1022495928 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c0fb320 con 0x7fe16c10cf90 2026-02-13T03:45:34.110 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.087+0000 7f86c89ce6c0 1 -- 10.20.193.70:0/696208478 <== osd.11 v2:10.20.193.177:6824/3785556542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f86980fd830 con 0x7f86980dcd70 2026-02-13T03:45:34.110 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.087+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1022495928 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe16c052a50 con 0x7fe16c10cf90 2026-02-13T03:45:34.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.088+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 --> [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8340179300 con 0x7f83180dccf0 2026-02-13T03:45:34.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.088+0000 7fe1537fe6c0 1 -- 10.20.193.70:0/1022495928 <== mon.2 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fe15c003870 con 0x7fe16c10cf90 2026-02-13T03:45:34.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.088+0000 7f83277fe6c0 1 -- 10.20.193.70:0/3211919951 <== osd.3 v2:10.20.193.70:6810/3715748086 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8340179300 con 0x7f83180dccf0 2026-02-13T03:45:34.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.088+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] conn(0x7f83180dccf0 msgr2=0x7f83180fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.088+0000 7f8344cb86c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6810/3715748086,v1:10.20.193.70:6811/3715748086] conn(0x7f83180dccf0 0x7f83180fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.088+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83180b5710 msgr2=0x7f83180d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.088+0000 7f8344cb86c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f83180b5710 0x7f83180d5bc0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8334005b40 tx=0x7f8334009310 comp rx=0 tx=0).stop 2026-02-13T03:45:34.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.088+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8340115440 msgr2=0x7f834011d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.088+0000 7f8344cb86c0 1 --2- 10.20.193.70:0/3211919951 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f8340115440 0x7f834011d730 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8328005dc0 tx=0x7f832800bbb0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.112 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7fe1537fe6c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1480b5710 0x7fe1480d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.112 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7fe171a236c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1480b5710 0x7fe1480d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.112 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7f833ed766c0 1 -- 10.20.193.70:0/3211919951 reap_dead start 2026-02-13T03:45:34.112 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 shutdown_connections 2026-02-13T03:45:34.112 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 >> 10.20.193.70:0/3211919951 conn(0x7f83400ecb30 msgr2=0x7f834010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.112 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 shutdown_connections 2026-02-13T03:45:34.112 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7fe171a236c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1480b5710 0x7fe1480d5bc0 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1600092e0 tx=0x7fe160005ae0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.112 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7fe1537fe6c0 1 -- 10.20.193.70:0/1022495928 <== mon.2 v2:10.20.193.127:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fe15c0e3a90 con 0x7fe16c10cf90 2026-02-13T03:45:34.113 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7fe1537fe6c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] conn(0x7fe1480dccf0 0x7fe1480fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.113 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7f8344cb86c0 1 -- 10.20.193.70:0/3211919951 wait complete. 2026-02-13T03:45:34.113 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.089+0000 7fe172a256c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] conn(0x7fe1480dccf0 0x7fe1480fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.113 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.090+0000 7fe1537fe6c0 1 -- 10.20.193.70:0/1022495928 --> [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1480fd7b0 con 0x7fe1480dccf0 2026-02-13T03:45:34.113 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.090+0000 7fe172a256c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] conn(0x7fe1480dccf0 0x7fe1480fd100 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.113 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.090+0000 7fe1537fe6c0 1 -- 10.20.193.70:0/1022495928 <== mon.2 v2:10.20.193.127:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fe15c0e3e40 con 0x7fe16c10cf90 2026-02-13T03:45:34.113 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.090+0000 7fe1537fe6c0 1 -- 10.20.193.70:0/1022495928 <== osd.9 v2:10.20.193.70:6826/1992888403 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fe1480fd7b0 con 0x7fe1480dccf0 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.095+0000 7f907fb086c0 1 -- 10.20.193.70:0/3867048527 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f907810d980 msgr2=0x7f90781129c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.095+0000 7f907fb086c0 1 --2- 10.20.193.70:0/3867048527 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f907810d980 0x7f90781129c0 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=4011823793429015616 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f906c0099a0 tx=0x7f906c02ed70 comp rx=0 tx=0).stop 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.095+0000 7f907fb086c0 1 -- 10.20.193.70:0/3867048527 shutdown_connections 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.095+0000 7f907fb086c0 1 --2- 10.20.193.70:0/3867048527 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f90781131a0 0x7f9078173b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.095+0000 7f907fb086c0 1 --2- 10.20.193.70:0/3867048527 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f907810d980 0x7f90781129c0 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=4011823793429015616 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.095+0000 7f907fb086c0 1 --2- 10.20.193.70:0/3867048527 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f907810cf90 0x7f907810d360 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.095+0000 7f907fb086c0 1 -- 10.20.193.70:0/3867048527 >> 10.20.193.70:0/3867048527 conn(0x7f90780ea830 msgr2=0x7f907810ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.095+0000 7f907fb086c0 1 -- 10.20.193.70:0/3867048527 shutdown_connections 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.095+0000 7f907fb086c0 1 -- 10.20.193.70:0/3867048527 wait complete. 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907fb086c0 1 Processor -- start 2026-02-13T03:45:34.114 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907fb086c0 1 -- start start 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907fb086c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f907810cf90 0x7f90780f8fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907fb086c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90781131a0 0x7f9078173a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907fb086c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f90780f95f0 0x7f90780fe870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907fb086c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f90780f9ce0 con 0x7f907810cf90 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907fb086c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f90780fedb0 con 0x7f90780f95f0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907fb086c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90780fef70 con 0x7f90781131a0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907d07c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90781131a0 0x7f9078173a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907d07c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90781131a0 0x7f9078173a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:56908/0 (socket says 10.20.193.70:56908) 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907d07c6c0 1 -- 10.20.193.70:0/1929355987 learned_addr learned my addr 10.20.193.70:0/1929355987 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907d87d6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f907810cf90 0x7f90780f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907e07e6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f90780f95f0 0x7f90780fe870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907d07c6c0 1 -- 10.20.193.70:0/1929355987 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f90780f95f0 msgr2=0x7f90780fe870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907d07c6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f90780f95f0 0x7f90780fe870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907d07c6c0 1 -- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f907810cf90 msgr2=0x7f90780f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907d07c6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f907810cf90 0x7f90780f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.096+0000 7f907d07c6c0 1 -- 10.20.193.70:0/1929355987 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906c009590 con 0x7f90781131a0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.097+0000 7f907d87d6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f907810cf90 0x7f90780f8fc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.097+0000 7f907d07c6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90781131a0 0x7f9078173a40 secure :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f906c02f900 tx=0x7f906c002960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.097+0000 7f9066ffd6c0 1 -- 10.20.193.70:0/1929355987 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f906c005e60 con 0x7f90781131a0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.097+0000 7f907fb086c0 1 -- 10.20.193.70:0/1929355987 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90780ff1f0 con 0x7f90781131a0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.097+0000 7f9066ffd6c0 1 -- 10.20.193.70:0/1929355987 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f906c02fcd0 con 0x7f90781131a0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.097+0000 7f9066ffd6c0 1 -- 10.20.193.70:0/1929355987 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f906c037360 con 0x7f90781131a0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.097+0000 7f907fb086c0 1 -- 10.20.193.70:0/1929355987 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90780ff670 con 0x7f90781131a0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.097+0000 7f9064ff96c0 1 -- 10.20.193.70:0/1929355987 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9044000fe0 con 0x7f90781131a0 2026-02-13T03:45:34.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.098+0000 7fe1744b36c0 1 -- 10.20.193.70:0/1022495928 --> [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe16c177100 con 0x7fe1480dccf0 2026-02-13T03:45:34.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f9066ffd6c0 1 -- 10.20.193.70:0/1929355987 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f906c0071c0 con 0x7f90781131a0 2026-02-13T03:45:34.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7fe1537fe6c0 1 -- 10.20.193.70:0/1022495928 <== osd.9 v2:10.20.193.70:6826/1992888403 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe16c177100 con 0x7fe1480dccf0 2026-02-13T03:45:34.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f9066ffd6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90540b5790 0x7f90540d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.098+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 --> [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86c4177080 con 0x7f86980dcd70 2026-02-13T03:45:34.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.098+0000 7f86c89ce6c0 1 -- 10.20.193.70:0/696208478 <== osd.11 v2:10.20.193.177:6824/3785556542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f86c4177080 con 0x7f86980dcd70 2026-02-13T03:45:34.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 >> [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] conn(0x7f86980dcd70 msgr2=0x7f86980fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.177:6824/3785556542,v1:10.20.193.177:6825/3785556542] conn(0x7f86980dcd70 0x7f86980fd180 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f86980b5790 msgr2=0x7f86980d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f86980b5790 0x7f86980d5c40 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86b8004750 tx=0x7f86b8009260 comp rx=0 tx=0).stop 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f86c41131c0 msgr2=0x7f86c4173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 --2- 10.20.193.70:0/696208478 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f86c41131c0 0x7f86c4173a60 secure :-1 s=READY pgs=273 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86ac02f230 tx=0x7f86ac02fb80 comp rx=0 tx=0).stop 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c37fe6c0 1 -- 10.20.193.70:0/696208478 reap_dead start 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f9066ffd6c0 1 -- 10.20.193.70:0/1929355987 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f906c107e50 con 0x7f90781131a0 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 shutdown_connections 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 >> 10.20.193.70:0/696208478 conn(0x7f86c40ea8b0 msgr2=0x7f86c410b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 shutdown_connections 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f86c99d06c0 1 -- 10.20.193.70:0/696208478 wait complete. 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f9066ffd6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] conn(0x7f90540dcd70 0x7f90540fd180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f9066ffd6c0 1 -- 10.20.193.70:0/1929355987 --> [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90540fd830 con 0x7f90540dcd70 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7f9066ffd6c0 1 -- 10.20.193.70:0/1929355987 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f906c108180 con 0x7f90781131a0 2026-02-13T03:45:34.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7fe1517fa6c0 1 -- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] conn(0x7fe1480dccf0 msgr2=0x7fe1480fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7fe1517fa6c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6826/1992888403,v1:10.20.193.70:6827/1992888403] conn(0x7fe1480dccf0 0x7fe1480fd100 crc :-1 s=READY pgs=8 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.099+0000 7fe1517fa6c0 1 -- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1480b5710 msgr2=0x7fe1480d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7fe1517fa6c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe1480b5710 0x7fe1480d5bc0 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1600092e0 tx=0x7fe160005ae0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7fe1517fa6c0 1 -- 10.20.193.70:0/1022495928 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe16c10cf90 msgr2=0x7fe16c0f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7fe1517fa6c0 1 --2- 10.20.193.70:0/1022495928 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe16c10cf90 0x7fe16c0f4bc0 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe15c00b6c0 tx=0x7fe15c00bb90 comp rx=0 tx=0).stop 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7f907d87d6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90540b5790 0x7f90540d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7fe172a256c0 1 -- 10.20.193.70:0/1022495928 reap_dead start 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7f907e07e6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] conn(0x7f90540dcd70 0x7f90540fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7fe1517fa6c0 1 -- 10.20.193.70:0/1022495928 shutdown_connections 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7fe1517fa6c0 1 -- 10.20.193.70:0/1022495928 >> 10.20.193.70:0/1022495928 conn(0x7fe16c0ea8b0 msgr2=0x7fe16c10b470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7fe1517fa6c0 1 -- 10.20.193.70:0/1022495928 shutdown_connections 2026-02-13T03:45:34.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7fe1517fa6c0 1 -- 10.20.193.70:0/1022495928 wait complete. 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7f907d87d6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90540b5790 0x7f90540d5c40 secure :-1 s=READY pgs=196 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068004750 tx=0x7f9068009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.100+0000 7f907e07e6c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] conn(0x7f90540dcd70 0x7f90540fd180 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.101+0000 7f9066ffd6c0 1 -- 10.20.193.70:0/1929355987 <== osd.6 v2:10.20.193.70:6818/192941608 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f90540fd830 con 0x7f90540dcd70 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.110+0000 7f9064ff96c0 1 -- 10.20.193.70:0/1929355987 --> [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9044002d20 con 0x7f90540dcd70 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.111+0000 7f9066ffd6c0 1 -- 10.20.193.70:0/1929355987 <== osd.6 v2:10.20.193.70:6818/192941608 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9044002d20 con 0x7f90540dcd70 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.111+0000 7f9064ff96c0 1 -- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] conn(0x7f90540dcd70 msgr2=0x7f90540fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.111+0000 7f9064ff96c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6818/192941608,v1:10.20.193.70:6819/192941608] conn(0x7f90540dcd70 0x7f90540fd180 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.111+0000 7f9064ff96c0 1 -- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90540b5790 msgr2=0x7f90540d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.111+0000 7f9064ff96c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90540b5790 0x7f90540d5c40 secure :-1 s=READY pgs=196 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068004750 tx=0x7f9068009260 comp rx=0 tx=0).stop 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.111+0000 7f9064ff96c0 1 -- 10.20.193.70:0/1929355987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90781131a0 msgr2=0x7f9078173a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.111+0000 7f9064ff96c0 1 --2- 10.20.193.70:0/1929355987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90781131a0 0x7f9078173a40 secure :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f906c02f900 tx=0x7f906c002960 comp rx=0 tx=0).stop 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.111+0000 7f907e07e6c0 1 -- 10.20.193.70:0/1929355987 reap_dead start 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.112+0000 7f9064ff96c0 1 -- 10.20.193.70:0/1929355987 shutdown_connections 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.112+0000 7f9064ff96c0 1 -- 10.20.193.70:0/1929355987 >> 10.20.193.70:0/1929355987 conn(0x7f90780ea830 msgr2=0x7f9078111920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.112+0000 7f9064ff96c0 1 -- 10.20.193.70:0/1929355987 shutdown_connections 2026-02-13T03:45:34.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.112+0000 7f9064ff96c0 1 -- 10.20.193.70:0/1929355987 wait complete. 2026-02-13T03:45:34.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.118+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/3579311107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefb4062ad0 msgr2=0x7fefb4062ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.118+0000 7fefbba6c6c0 1 --2- 10.20.193.70:0/3579311107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefb4062ad0 0x7fefb4062ea0 secure :-1 s=READY pgs=53 gs=3 cs=0 l=1 c_cookie=7136039658709079180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefa40098a0 tx=0x7fefa402ec40 comp rx=0 tx=0).stop 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.118+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/3579311107 shutdown_connections 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.118+0000 7fefbba6c6c0 1 --2- 10.20.193.70:0/3579311107 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fefb410f2d0 0x7fefb410f770 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.118+0000 7fefbba6c6c0 1 --2- 10.20.193.70:0/3579311107 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40633e0 0x7fefb410ed90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.118+0000 7fefbba6c6c0 1 --2- 10.20.193.70:0/3579311107 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefb4062ad0 0x7fefb4062ea0 unknown :-1 s=CLOSED pgs=53 gs=3 cs=0 l=1 c_cookie=7136039658709079180 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.118+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/3579311107 >> 10.20.193.70:0/3579311107 conn(0x7fefb40ecb30 msgr2=0x7fefb410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.119+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/3579311107 shutdown_connections 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.119+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/3579311107 wait complete. 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.119+0000 7fefbba6c6c0 1 Processor -- start 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.119+0000 7fefbba6c6c0 1 -- start start 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefbba6c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb4062ad0 0x7fefb41a39b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefbba6c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fefb40633e0 0x7fefb41a3ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefbba6c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefb410f2d0 0x7fefb41a92b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefbba6c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41a9950 con 0x7fefb40633e0 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefbba6c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41a9ac0 con 0x7fefb410f2d0 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefbba6c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fefb41a9c80 con 0x7fefb4062ad0 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb97dd6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb4062ad0 0x7fefb41a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb97dd6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb4062ad0 0x7fefb41a39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:56926/0 (socket says 10.20.193.70:56926) 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb97dd6c0 1 -- 10.20.193.70:0/373087038 learned_addr learned my addr 10.20.193.70:0/373087038 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb9fde6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefb410f2d0 0x7fefb41a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb8fdc6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fefb40633e0 0x7fefb41a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb97dd6c0 1 -- 10.20.193.70:0/373087038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefb410f2d0 msgr2=0x7fefb41a92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb97dd6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fefb410f2d0 0x7fefb41a92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb97dd6c0 1 -- 10.20.193.70:0/373087038 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fefb40633e0 msgr2=0x7fefb41a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb97dd6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fefb40633e0 0x7fefb41a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb97dd6c0 1 -- 10.20.193.70:0/373087038 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb000a660 con 0x7fefb4062ad0 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb8fdc6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fefb40633e0 0x7fefb41a3ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefb97dd6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb4062ad0 0x7fefb41a39b0 secure :-1 s=READY pgs=57 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefa40091a0 tx=0x7fefa402fb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefa27fc6c0 1 -- 10.20.193.70:0/373087038 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefa4002ae0 con 0x7fefb4062ad0 2026-02-13T03:45:34.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefa27fc6c0 1 -- 10.20.193.70:0/373087038 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fefa4005d50 con 0x7fefb4062ad0 2026-02-13T03:45:34.123 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefa27fc6c0 1 -- 10.20.193.70:0/373087038 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefa4031030 con 0x7fefb4062ad0 2026-02-13T03:45:34.123 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.120+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa40094c0 con 0x7fefb4062ad0 2026-02-13T03:45:34.123 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.121+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb420a430 con 0x7fefb4062ad0 2026-02-13T03:45:34.123 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.121+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fefb4052a50 con 0x7fefb4062ad0 2026-02-13T03:45:34.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.122+0000 7fefa27fc6c0 1 -- 10.20.193.70:0/373087038 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fefa40071c0 con 0x7fefb4062ad0 2026-02-13T03:45:34.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.123+0000 7fefa27fc6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fef900b5710 0x7fef900d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.123+0000 7fefb8fdc6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fef900b5710 0x7fef900d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.123+0000 7fefa27fc6c0 1 -- 10.20.193.70:0/373087038 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fefa4107cc0 con 0x7fefb4062ad0 2026-02-13T03:45:34.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.123+0000 7fefa27fc6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] conn(0x7fef900dccf0 0x7fef900fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.123+0000 7fefa27fc6c0 1 -- 10.20.193.70:0/373087038 --> [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef900fd7b0 con 0x7fef900dccf0 2026-02-13T03:45:34.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.123+0000 7fefa27fc6c0 1 -- 10.20.193.70:0/373087038 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fefa4108070 con 0x7fefb4062ad0 2026-02-13T03:45:34.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.123+0000 7fefb9fde6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] conn(0x7fef900dccf0 0x7fef900fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.124+0000 7fefb8fdc6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fef900b5710 0x7fef900d5bc0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefb40657b0 tx=0x7fefa8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.124+0000 7fefb9fde6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] conn(0x7fef900dccf0 0x7fef900fd100 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.126+0000 7fefa27fc6c0 1 -- 10.20.193.70:0/373087038 <== osd.10 v2:10.20.193.127:6824/380098770 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fef900fd7b0 con 0x7fef900dccf0 2026-02-13T03:45:34.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.131+0000 7f6385e906c0 1 -- 10.20.193.70:0/2905985470 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6380115440 msgr2=0x7f6380175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.131+0000 7f6385e906c0 1 --2- 10.20.193.70:0/2905985470 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6380115440 0x7f6380175de0 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=14747800509124830447 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f637400a9b0 tx=0x7f637402fd20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 -- 10.20.193.70:0/2905985470 shutdown_connections 2026-02-13T03:45:34.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 --2- 10.20.193.70:0/2905985470 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6380115440 0x7f6380175de0 unknown :-1 s=CLOSED pgs=275 gs=1 cs=0 l=1 c_cookie=14747800509124830447 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 --2- 10.20.193.70:0/2905985470 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f638010fc20 0x7f6380114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 --2- 10.20.193.70:0/2905985470 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638010f230 0x7f638010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 -- 10.20.193.70:0/2905985470 >> 10.20.193.70:0/2905985470 conn(0x7f63800ecb30 msgr2=0x7f638010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 -- 10.20.193.70:0/2905985470 shutdown_connections 2026-02-13T03:45:34.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 -- 10.20.193.70:0/2905985470 wait complete. 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 Processor -- start 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 -- start start 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f638010f230 0x7f63800564a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6380115440 0x7f63800569e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638005bda0 0x7f638005c240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f638005c7b0 con 0x7f6380115440 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f638005c920 con 0x7f638010f230 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f6385e906c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f638005cae0 con 0x7f638005bda0 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f637f7fe6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f638010f230 0x7f63800564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f637effd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6380115440 0x7f63800569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f637ffff6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638005bda0 0x7f638005c240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f637f7fe6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f638010f230 0x7f63800564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:56942/0 (socket says 10.20.193.70:56942) 2026-02-13T03:45:34.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f637ffff6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638005bda0 0x7f638005c240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:56934/0 (socket says 10.20.193.70:56934) 2026-02-13T03:45:34.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.132+0000 7f637f7fe6c0 1 -- 10.20.193.70:0/2285347399 learned_addr learned my addr 10.20.193.70:0/2285347399 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637ffff6c0 1 -- 10.20.193.70:0/2285347399 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f638010f230 msgr2=0x7f63800564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637ffff6c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f638010f230 0x7f63800564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637ffff6c0 1 -- 10.20.193.70:0/2285347399 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6380115440 msgr2=0x7f63800569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637ffff6c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6380115440 0x7f63800569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637ffff6c0 1 -- 10.20.193.70:0/2285347399 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637400a5b0 con 0x7f638005bda0 2026-02-13T03:45:34.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637effd6c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6380115440 0x7f63800569e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:45:34.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637ffff6c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638005bda0 0x7f638005c240 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6374030230 tx=0x7f6374030bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.137 INFO:teuthology.orchestra.run.trial070.stdout:111669149713 2026-02-13T03:45:34.137 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T03:45:34.138 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637cff96c0 1 -- 10.20.193.70:0/2285347399 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6374003c40 con 0x7f638005bda0 2026-02-13T03:45:34.138 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637cff96c0 1 -- 10.20.193.70:0/2285347399 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6374003da0 con 0x7f638005bda0 2026-02-13T03:45:34.138 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f637cff96c0 1 -- 10.20.193.70:0/2285347399 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6374037380 con 0x7f638005bda0 2026-02-13T03:45:34.138 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638005cf10 con 0x7f638005bda0 2026-02-13T03:45:34.138 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.133+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638005d340 con 0x7f638005bda0 2026-02-13T03:45:34.138 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.134+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6380052a50 con 0x7f638005bda0 2026-02-13T03:45:34.138 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7f637cff96c0 1 -- 10.20.193.70:0/2285347399 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f63740081c0 con 0x7f638005bda0 2026-02-13T03:45:34.139 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 --> [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fefb404cc70 con 0x7fef900dccf0 2026-02-13T03:45:34.139 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7fefa27fc6c0 1 -- 10.20.193.70:0/373087038 <== osd.10 v2:10.20.193.127:6824/380098770 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fefb404cc70 con 0x7fef900dccf0 2026-02-13T03:45:34.140 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7f637cff96c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f63540b5710 0x7f63540d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.140 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7f637cff96c0 1 -- 10.20.193.70:0/2285347399 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f6374108af0 con 0x7f638005bda0 2026-02-13T03:45:34.140 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7f637f7fe6c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f63540b5710 0x7f63540d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.140 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7f637cff96c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] conn(0x7f63540dccf0 0x7f63540fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.140 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7f637cff96c0 1 -- 10.20.193.70:0/2285347399 --> [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63540fd7b0 con 0x7f63540dccf0 2026-02-13T03:45:34.140 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7f637cff96c0 1 -- 10.20.193.70:0/2285347399 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f6374108f10 con 0x7f638005bda0 2026-02-13T03:45:34.141 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 >> [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] conn(0x7fef900dccf0 msgr2=0x7fef900fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.141 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.135+0000 7fefbba6c6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.127:6824/380098770,v1:10.20.193.127:6825/380098770] conn(0x7fef900dccf0 0x7fef900fd100 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.141 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fef900b5710 msgr2=0x7fef900d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.141 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7fefbba6c6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fef900b5710 0x7fef900d5bc0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefb40657b0 tx=0x7fefa8009260 comp rx=0 tx=0).stop 2026-02-13T03:45:34.141 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb4062ad0 msgr2=0x7fefb41a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.141 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7fefbba6c6c0 1 --2- 10.20.193.70:0/373087038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb4062ad0 0x7fefb41a39b0 secure :-1 s=READY pgs=57 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefa40091a0 tx=0x7fefa402fb20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.141 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7f637f7fe6c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f63540b5710 0x7f63540d5bc0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f636c005b40 tx=0x7f636c009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7fefb9fde6c0 1 -- 10.20.193.70:0/373087038 reap_dead start 2026-02-13T03:45:34.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 shutdown_connections 2026-02-13T03:45:34.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 >> 10.20.193.70:0/373087038 conn(0x7fefb40ecb30 msgr2=0x7fefb410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7f637effd6c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] conn(0x7f63540dccf0 0x7f63540fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 shutdown_connections 2026-02-13T03:45:34.143 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.136+0000 7fefbba6c6c0 1 -- 10.20.193.70:0/373087038 wait complete. 2026-02-13T03:45:34.143 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.137+0000 7f637effd6c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] conn(0x7f63540dccf0 0x7f63540fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.143 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.137+0000 7f637cff96c0 1 -- 10.20.193.70:0/2285347399 <== osd.7 v2:10.20.193.127:6816/3503194265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f63540fd7b0 con 0x7f63540dccf0 2026-02-13T03:45:34.145 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.138+0000 7f343c3c46c0 1 -- 10.20.193.70:0/609497210 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f343410b5e0 msgr2=0x7f343410b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.145 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.138+0000 7f343c3c46c0 1 --2- 10.20.193.70:0/609497210 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f343410b5e0 0x7f343410b9b0 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=3725153186987837525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f342400aaf0 tx=0x7f342402fe50 comp rx=0 tx=0).stop 2026-02-13T03:45:34.145 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.139+0000 7f343c3c46c0 1 -- 10.20.193.70:0/609497210 shutdown_connections 2026-02-13T03:45:34.145 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.139+0000 7f343c3c46c0 1 --2- 10.20.193.70:0/609497210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34341117f0 0x7f3434172190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.145 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.139+0000 7f343c3c46c0 1 --2- 10.20.193.70:0/609497210 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f343410bfd0 0x7f3434111010 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.139+0000 7f343c3c46c0 1 --2- 10.20.193.70:0/609497210 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f343410b5e0 0x7f343410b9b0 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=3725153186987837525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.139+0000 7f343c3c46c0 1 -- 10.20.193.70:0/609497210 >> 10.20.193.70:0/609497210 conn(0x7f3434062e00 msgr2=0x7f3434109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.139+0000 7f343c3c46c0 1 -- 10.20.193.70:0/609497210 shutdown_connections 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.139+0000 7f343c3c46c0 1 -- 10.20.193.70:0/609497210 wait complete. 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343c3c46c0 1 Processor -- start 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343c3c46c0 1 -- start start 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343c3c46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f343410b5e0 0x7f34340f4650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343c3c46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f34341117f0 0x7f3434172090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343c3c46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34340f4c80 0x7f34340f9f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343c3c46c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34340f5370 con 0x7f34341117f0 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343c3c46c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f34340fa490 con 0x7f343410b5e0 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343c3c46c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f34340fa650 con 0x7f34340f4c80 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343a1356c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f343410b5e0 0x7f34340f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f34399346c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f34341117f0 0x7f3434172090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.146 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f34399346c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f34341117f0 0x7f3434172090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:33972/0 (socket says 10.20.193.70:33972) 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f34399346c0 1 -- 10.20.193.70:0/4163060111 learned_addr learned my addr 10.20.193.70:0/4163060111 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f343a9366c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34340f4c80 0x7f34340f9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f34399346c0 1 -- 10.20.193.70:0/4163060111 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34340f4c80 msgr2=0x7f34340f9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f34399346c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34340f4c80 0x7f34340f9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f34399346c0 1 -- 10.20.193.70:0/4163060111 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f343410b5e0 msgr2=0x7f34340f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f34399346c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f343410b5e0 0x7f34340f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f34399346c0 1 -- 10.20.193.70:0/4163060111 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342400a6e0 con 0x7f34341117f0 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.140+0000 7f34399346c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f34341117f0 0x7f3434172090 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3428005dc0 tx=0x7f342800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.141+0000 7f341b7fe6c0 1 -- 10.20.193.70:0/4163060111 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3428004250 con 0x7f34341117f0 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.141+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34340fa930 con 0x7f34341117f0 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.141+0000 7f341b7fe6c0 1 -- 10.20.193.70:0/4163060111 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3428009070 con 0x7f34341117f0 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.141+0000 7f341b7fe6c0 1 -- 10.20.193.70:0/4163060111 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f342800cde0 con 0x7f34341117f0 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.141+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34340e9650 con 0x7f34341117f0 2026-02-13T03:45:34.147 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.141+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3434052a50 con 0x7f34341117f0 2026-02-13T03:45:34.148 INFO:teuthology.orchestra.run.trial070.stdout:201863462925 2026-02-13T03:45:34.149 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.143+0000 7f341b7fe6c0 1 -- 10.20.193.70:0/4163060111 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f34280028c0 con 0x7f34341117f0 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.144+0000 7f341b7fe6c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f34100b5710 0x7f34100d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.144+0000 7f343a1356c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f34100b5710 0x7f34100d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.144+0000 7f341b7fe6c0 1 -- 10.20.193.70:0/4163060111 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f34280e39b0 con 0x7f34341117f0 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.144+0000 7f341b7fe6c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] conn(0x7f34100dccf0 0x7f34100fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.144+0000 7f341b7fe6c0 1 -- 10.20.193.70:0/4163060111 --> [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34100fd7b0 con 0x7f34100dccf0 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.144+0000 7f341b7fe6c0 1 -- 10.20.193.70:0/4163060111 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f34280e3dd0 con 0x7f34341117f0 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.144+0000 7f343a1356c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f34100b5710 0x7f34100d5bc0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3424030fd0 tx=0x7f34240023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.144+0000 7f343a9366c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] conn(0x7f34100dccf0 0x7f34100fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.144+0000 7f343a9366c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] conn(0x7f34100dccf0 0x7f34100fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.150 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.145+0000 7f341b7fe6c0 1 -- 10.20.193.70:0/4163060111 <== osd.0 v2:10.20.193.70:6802/1468748446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f34100fd7b0 con 0x7f34100dccf0 2026-02-13T03:45:34.151 INFO:teuthology.orchestra.run.trial070.stdout:124554051601 2026-02-13T03:45:34.151 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T03:45:34.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.146+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 --> [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6380179290 con 0x7f63540dccf0 2026-02-13T03:45:34.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.146+0000 7f637cff96c0 1 -- 10.20.193.70:0/2285347399 <== osd.7 v2:10.20.193.127:6816/3503194265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6380179290 con 0x7f63540dccf0 2026-02-13T03:45:34.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 >> [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] conn(0x7f63540dccf0 msgr2=0x7f63540fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.127:6816/3503194265,v1:10.20.193.127:6817/3503194265] conn(0x7f63540dccf0 0x7f63540fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f63540b5710 msgr2=0x7f63540d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f63540b5710 0x7f63540d5bc0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f636c005b40 tx=0x7f636c009310 comp rx=0 tx=0).stop 2026-02-13T03:45:34.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638005bda0 msgr2=0x7f638005c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 --2- 10.20.193.70:0/2285347399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638005bda0 0x7f638005c240 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6374030230 tx=0x7f6374030bf0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f637ffff6c0 1 -- 10.20.193.70:0/2285347399 reap_dead start 2026-02-13T03:45:34.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 shutdown_connections 2026-02-13T03:45:34.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 >> 10.20.193.70:0/2285347399 conn(0x7f63800ecb30 msgr2=0x7f638010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 shutdown_connections 2026-02-13T03:45:34.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.147+0000 7f6385e906c0 1 -- 10.20.193.70:0/2285347399 wait complete. 2026-02-13T03:45:34.154 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 --> [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3434174da0 con 0x7f34100dccf0 2026-02-13T03:45:34.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f341b7fe6c0 1 -- 10.20.193.70:0/4163060111 <== osd.0 v2:10.20.193.70:6802/1468748446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3434174da0 con 0x7f34100dccf0 2026-02-13T03:45:34.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] conn(0x7f34100dccf0 msgr2=0x7f34100fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6802/1468748446,v1:10.20.193.70:6803/1468748446] conn(0x7f34100dccf0 0x7f34100fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f34100b5710 msgr2=0x7f34100d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f34100b5710 0x7f34100d5bc0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3424030fd0 tx=0x7f34240023a0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f34341117f0 msgr2=0x7f3434172090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 --2- 10.20.193.70:0/4163060111 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f34341117f0 0x7f3434172090 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3428005dc0 tx=0x7f342800bbb0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343a9366c0 1 -- 10.20.193.70:0/4163060111 reap_dead start 2026-02-13T03:45:34.157 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 shutdown_connections 2026-02-13T03:45:34.157 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 >> 10.20.193.70:0/4163060111 conn(0x7f3434062e00 msgr2=0x7f3434110050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.157 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 shutdown_connections 2026-02-13T03:45:34.157 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.153+0000 7f343c3c46c0 1 -- 10.20.193.70:0/4163060111 wait complete. 2026-02-13T03:45:34.158 INFO:teuthology.orchestra.run.trial070.stdout:55834574869 2026-02-13T03:45:34.158 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T03:45:34.188 INFO:teuthology.orchestra.run.trial070.stdout:81604378644 2026-02-13T03:45:34.188 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T03:45:34.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:33 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/840782958' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:34.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:33 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3697741299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:34.208 INFO:teuthology.orchestra.run.trial070.stdout:231928233995 2026-02-13T03:45:34.209 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T03:45:34.217 INFO:teuthology.orchestra.run.trial070.stdout:154618822672 2026-02-13T03:45:34.218 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T03:45:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:33 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/840782958' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:33 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3697741299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T03:45:34.234 INFO:teuthology.orchestra.run.trial070.stdout:42949672982 2026-02-13T03:45:34.235 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T03:45:34.237 INFO:teuthology.orchestra.run.trial070.stdout:279172874249 2026-02-13T03:45:34.237 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T03:45:34.239 INFO:teuthology.orchestra.run.trial070.stdout:171798691853 2026-02-13T03:45:34.239 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T03:45:34.258 INFO:teuthology.orchestra.run.trial070.stdout:30064771096 2026-02-13T03:45:34.258 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T03:45:34.262 INFO:teuthology.orchestra.run.trial070.stdout:249108103178 2026-02-13T03:45:34.263 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T03:45:34.283 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.285 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.297 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.348 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.352 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.370 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.370 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.397 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.401 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.402 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.404 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.429 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:34.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 -- 10.20.193.70:0/2215996753 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56f0115440 msgr2=0x7f56f0175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 --2- 10.20.193.70:0/2215996753 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56f0115440 0x7f56f0175de0 secure :-1 s=READY pgs=54 gs=2 cs=0 l=1 c_cookie=17568950866881785764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e0006fd0 tx=0x7f56e002fd20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 -- 10.20.193.70:0/2215996753 shutdown_connections 2026-02-13T03:45:34.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 --2- 10.20.193.70:0/2215996753 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56f0115440 0x7f56f0175de0 unknown :-1 s=CLOSED pgs=54 gs=2 cs=0 l=1 c_cookie=17568950866881785764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 --2- 10.20.193.70:0/2215996753 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f56f010fc20 0x7f56f0114c60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 --2- 10.20.193.70:0/2215996753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56f010f230 0x7f56f010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 -- 10.20.193.70:0/2215996753 >> 10.20.193.70:0/2215996753 conn(0x7f56f00ecb30 msgr2=0x7f56f010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 -- 10.20.193.70:0/2215996753 shutdown_connections 2026-02-13T03:45:34.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 -- 10.20.193.70:0/2215996753 wait complete. 2026-02-13T03:45:34.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 Processor -- start 2026-02-13T03:45:34.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.441+0000 7f56f519c6c0 1 -- start start 2026-02-13T03:45:34.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56f519c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f56f010f230 0x7f56f017d9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56f519c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56f0115440 0x7f56f0175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56f519c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56f017dee0 0x7f56f017e380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56f519c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0101340 con 0x7f56f010f230 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56f519c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f56f01014b0 con 0x7f56f0115440 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56f519c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0101670 con 0x7f56f017dee0 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56eed766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f56f010f230 0x7f56f017d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56eed766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f56f010f230 0x7f56f017d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34000/0 (socket says 10.20.193.70:34000) 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56eed766c0 1 -- 10.20.193.70:0/476857168 learned_addr learned my addr 10.20.193.70:0/476857168 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56ef5776c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56f017dee0 0x7f56f017e380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56ee5756c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56f0115440 0x7f56f0175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.448 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56eed766c0 1 -- 10.20.193.70:0/476857168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56f017dee0 msgr2=0x7f56f017e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.448 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56eed766c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56f017dee0 0x7f56f017e380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.448 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56eed766c0 1 -- 10.20.193.70:0/476857168 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56f0115440 msgr2=0x7f56f0175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.448 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56eed766c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56f0115440 0x7f56f0175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.448 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56eed766c0 1 -- 10.20.193.70:0/476857168 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e000a5b0 con 0x7f56f010f230 2026-02-13T03:45:34.448 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56eed766c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f56f010f230 0x7f56f017d9a0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e400b6c0 tx=0x7f56e400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.448 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56cffff6c0 1 -- 10.20.193.70:0/476857168 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56e40044a0 con 0x7f56f010f230 2026-02-13T03:45:34.448 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56cffff6c0 1 -- 10.20.193.70:0/476857168 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f56e400be50 con 0x7f56f010f230 2026-02-13T03:45:34.448 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.442+0000 7f56cffff6c0 1 -- 10.20.193.70:0/476857168 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56e400cd00 con 0x7f56f010f230 2026-02-13T03:45:34.449 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.443+0000 7f56f519c6c0 1 -- 10.20.193.70:0/476857168 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f0101950 con 0x7f56f010f230 2026-02-13T03:45:34.449 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.443+0000 7f56f519c6c0 1 -- 10.20.193.70:0/476857168 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f0101de0 con 0x7f56f010f230 2026-02-13T03:45:34.449 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.443+0000 7f56cdffb6c0 1 -- 10.20.193.70:0/476857168 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b8005310 con 0x7f56f010f230 2026-02-13T03:45:34.449 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.445+0000 7f56cffff6c0 1 -- 10.20.193.70:0/476857168 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f56e40026b0 con 0x7f56f010f230 2026-02-13T03:45:34.450 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.444+0000 7f68ddf176c0 1 -- 10.20.193.70:0/2190716218 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68d810f230 msgr2=0x7f68d810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.450 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.444+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/2190716218 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68d810f230 0x7f68d810f600 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=7721498989013439420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c40098d0 tx=0x7f68c402ec40 comp rx=0 tx=0).stop 2026-02-13T03:45:34.450 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.444+0000 7f68ddf176c0 1 -- 10.20.193.70:0/2190716218 shutdown_connections 2026-02-13T03:45:34.450 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.444+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/2190716218 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d8115440 0x7f68d8175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.450 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.444+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/2190716218 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68d810fc20 0x7f68d8114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.450 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.445+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/2190716218 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68d810f230 0x7f68d810f600 unknown :-1 s=CLOSED pgs=279 gs=1 cs=0 l=1 c_cookie=7721498989013439420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.450 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.445+0000 7f68ddf176c0 1 -- 10.20.193.70:0/2190716218 >> 10.20.193.70:0/2190716218 conn(0x7f68d80ecb30 msgr2=0x7f68d810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.450 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.445+0000 7f16f09876c0 1 -- 10.20.193.70:0/588461289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16e81131c0 msgr2=0x7f16e8173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.451 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.445+0000 7f16f09876c0 1 --2- 10.20.193.70:0/588461289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16e81131c0 0x7f16e8173b60 secure :-1 s=READY pgs=59 gs=2 cs=0 l=1 c_cookie=13777595109307434944 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16dc00aa70 tx=0x7f16dc034300 comp rx=0 tx=0).stop 2026-02-13T03:45:34.451 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.445+0000 7f68ddf176c0 1 -- 10.20.193.70:0/2190716218 shutdown_connections 2026-02-13T03:45:34.451 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.445+0000 7f68ddf176c0 1 -- 10.20.193.70:0/2190716218 wait complete. 2026-02-13T03:45:34.451 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f56cffff6c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f56c40b5690 0x7f56c40d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.452 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 -- 10.20.193.70:0/588461289 shutdown_connections 2026-02-13T03:45:34.452 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 --2- 10.20.193.70:0/588461289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16e81131c0 0x7f16e8173b60 unknown :-1 s=CLOSED pgs=59 gs=2 cs=0 l=1 c_cookie=13777595109307434944 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.452 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 --2- 10.20.193.70:0/588461289 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f16e810d9a0 0x7f16e81129e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.452 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 --2- 10.20.193.70:0/588461289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16e810cfb0 0x7f16e810d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.452 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 -- 10.20.193.70:0/588461289 >> 10.20.193.70:0/588461289 conn(0x7f16e80ea8b0 msgr2=0x7f16e810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.452 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 -- 10.20.193.70:0/588461289 shutdown_connections 2026-02-13T03:45:34.452 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 -- 10.20.193.70:0/588461289 wait complete. 2026-02-13T03:45:34.453 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f56cffff6c0 1 -- 10.20.193.70:0/476857168 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f56e40e3970 con 0x7f56f010f230 2026-02-13T03:45:34.453 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f56ee5756c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f56c40b5690 0x7f56c40d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.454 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 Processor -- start 2026-02-13T03:45:34.454 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 -- start start 2026-02-13T03:45:34.454 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f56ee5756c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f56c40b5690 0x7f56c40d5b40 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f01804a0 tx=0x7f56d8009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.454 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f68ddf176c0 1 Processor -- start 2026-02-13T03:45:34.455 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f68ddf176c0 1 -- start start 2026-02-13T03:45:34.455 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16e810cfb0 0x7f16e80f28f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.455 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f16e81131c0 0x7f16e8173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.456 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f56cffff6c0 1 -- 10.20.193.70:0/476857168 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f56e40a6460 con 0x7f56f010f230 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16e80f2f20 0x7f16e80f81f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f16e80f3610 con 0x7f16e81131c0 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f16e80f8730 con 0x7f16e810cfb0 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16f09876c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f16e80f88f0 con 0x7f16e80f2f20 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16edef76c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f16e81131c0 0x7f16e8173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16edef76c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f16e81131c0 0x7f16e8173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34040/0 (socket says 10.20.193.70:34040) 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16edef76c0 1 -- 10.20.193.70:0/254571819 learned_addr learned my addr 10.20.193.70:0/254571819 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16ee6f86c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16e810cfb0 0x7f16e80f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.446+0000 7f16eeef96c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16e80f2f20 0x7f16e80f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.457 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16edef76c0 1 -- 10.20.193.70:0/254571819 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16e80f2f20 msgr2=0x7f16e80f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.458 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16edef76c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16e80f2f20 0x7f16e80f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.458 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16edef76c0 1 -- 10.20.193.70:0/254571819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16e810cfb0 msgr2=0x7f16e80f28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.458 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16edef76c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16e810cfb0 0x7f16e80f28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.458 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16edef76c0 1 -- 10.20.193.70:0/254571819 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16dc00a660 con 0x7f16e81131c0 2026-02-13T03:45:34.458 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16ee6f86c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16e810cfb0 0x7f16e80f28f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:34.458 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68ddf176c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68d810f230 0x7f68d811d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16edef76c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f16e81131c0 0x7f16e8173a60 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e000b6c0 tx=0x7f16e000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68ddf176c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68d8115440 0x7f68d811d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16d37fe6c0 1 -- 10.20.193.70:0/254571819 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16e00044a0 con 0x7f16e81131c0 2026-02-13T03:45:34.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16d37fe6c0 1 -- 10.20.193.70:0/254571819 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f16e000be50 con 0x7f16e81131c0 2026-02-13T03:45:34.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16d37fe6c0 1 -- 10.20.193.70:0/254571819 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16e000cd20 con 0x7f16e81131c0 2026-02-13T03:45:34.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16f09876c0 1 -- 10.20.193.70:0/254571819 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e80f8bd0 con 0x7f16e81131c0 2026-02-13T03:45:34.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68ddf176c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d8122bf0 0x7f68d8123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68ddf176c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8123600 con 0x7f68d8115440 2026-02-13T03:45:34.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68ddf176c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8123770 con 0x7f68d8122bf0 2026-02-13T03:45:34.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d77fe6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68d810f230 0x7f68d811d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d77fe6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68d810f230 0x7f68d811d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:57010/0 (socket says 10.20.193.70:57010) 2026-02-13T03:45:34.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d77fe6c0 1 -- 10.20.193.70:0/919372343 learned_addr learned my addr 10.20.193.70:0/919372343 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8123930 con 0x7f68d810f230 2026-02-13T03:45:34.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d6ffd6c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68d8115440 0x7f68d811d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d7fff6c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d8122bf0 0x7f68d8123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f16f09876c0 1 -- 10.20.193.70:0/254571819 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e80f9000 con 0x7f16e81131c0 2026-02-13T03:45:34.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.448+0000 7f16d17fa6c0 1 -- 10.20.193.70:0/254571819 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b4005310 con 0x7f16e81131c0 2026-02-13T03:45:34.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.449+0000 7f16d37fe6c0 1 -- 10.20.193.70:0/254571819 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f16e00026b0 con 0x7f16e81131c0 2026-02-13T03:45:34.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.449+0000 7f16d37fe6c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f16c40b5710 0x7f16c40d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.462 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.450+0000 7f16ee6f86c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f16c40b5710 0x7f16c40d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.462 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.450+0000 7f16d37fe6c0 1 -- 10.20.193.70:0/254571819 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f16e00e3710 con 0x7f16e81131c0 2026-02-13T03:45:34.462 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.450+0000 7f16ee6f86c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f16c40b5710 0x7f16c40d5bc0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d4004750 tx=0x7f16d4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.462 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.450+0000 7f16d37fe6c0 1 -- 10.20.193.70:0/254571819 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f16e00a6170 con 0x7f16e81131c0 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d6ffd6c0 1 -- 10.20.193.70:0/919372343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68d810f230 msgr2=0x7f68d811d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d6ffd6c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68d810f230 0x7f68d811d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d6ffd6c0 1 -- 10.20.193.70:0/919372343 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d8122bf0 msgr2=0x7f68d8123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d6ffd6c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d8122bf0 0x7f68d8123090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d6ffd6c0 1 -- 10.20.193.70:0/919372343 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c40094c0 con 0x7f68d8115440 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.447+0000 7f68d6ffd6c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68d8115440 0x7f68d811d830 secure :-1 s=READY pgs=281 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c8004750 tx=0x7f68c800bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.448+0000 7f68d4ff96c0 1 -- 10.20.193.70:0/919372343 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68c8004240 con 0x7f68d8115440 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.448+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d8163de0 con 0x7f68d8115440 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.448+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d8164210 con 0x7f68d8115440 2026-02-13T03:45:34.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.450+0000 7f68d4ff96c0 1 -- 10.20.193.70:0/919372343 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f68c8009030 con 0x7f68d8115440 2026-02-13T03:45:34.464 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.451+0000 7f68d4ff96c0 1 -- 10.20.193.70:0/919372343 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68c80036e0 con 0x7f68d8115440 2026-02-13T03:45:34.464 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.451+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d8110500 con 0x7f68d8115440 2026-02-13T03:45:34.464 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.452+0000 7f68d4ff96c0 1 -- 10.20.193.70:0/919372343 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f68c8003870 con 0x7f68d8115440 2026-02-13T03:45:34.464 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.453+0000 7f68d4ff96c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f68ac0b5710 0x7f68ac0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.464 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.453+0000 7f68d77fe6c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f68ac0b5710 0x7f68ac0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.464 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.453+0000 7f68d4ff96c0 1 -- 10.20.193.70:0/919372343 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f68c80e3a00 con 0x7f68d8115440 2026-02-13T03:45:34.464 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.453+0000 7f68d77fe6c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f68ac0b5710 0x7f68ac0d5bc0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c40097f0 tx=0x7f68c40091a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.464 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.455+0000 7f68d4ff96c0 1 -- 10.20.193.70:0/919372343 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f68c80a6460 con 0x7f68d8115440 2026-02-13T03:45:34.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.491+0000 7f522f8ab6c0 1 -- 10.20.193.70:0/275276100 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f522810f210 msgr2=0x7f522810f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.491+0000 7f522f8ab6c0 1 --2- 10.20.193.70:0/275276100 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f522810f210 0x7f522810f5e0 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=12253463539246825319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52180098d0 tx=0x7f521802ec40 comp rx=0 tx=0).stop 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.491+0000 7f522f8ab6c0 1 -- 10.20.193.70:0/275276100 shutdown_connections 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.491+0000 7f522f8ab6c0 1 --2- 10.20.193.70:0/275276100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5228115420 0x7f5228175dc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 --2- 10.20.193.70:0/275276100 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f522810fc00 0x7f5228114c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 --2- 10.20.193.70:0/275276100 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f522810f210 0x7f522810f5e0 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=12253463539246825319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 -- 10.20.193.70:0/275276100 >> 10.20.193.70:0/275276100 conn(0x7f52280ecb30 msgr2=0x7f522810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 -- 10.20.193.70:0/275276100 shutdown_connections 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 -- 10.20.193.70:0/275276100 wait complete. 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 Processor -- start 2026-02-13T03:45:34.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 -- start start 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f522810f210 0x7f522811d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5228115420 0x7f522811d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5228122b20 0x7f5228122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5228123530 con 0x7f5228122b20 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f52281236a0 con 0x7f522810f210 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.492+0000 7f522f8ab6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5228123860 con 0x7f5228115420 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522de1d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5228122b20 0x7f5228122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522ce1b6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5228115420 0x7f522811d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522de1d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5228122b20 0x7f5228122fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34080/0 (socket says 10.20.193.70:34080) 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522de1d6c0 1 -- 10.20.193.70:0/3649563113 learned_addr learned my addr 10.20.193.70:0/3649563113 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522d61c6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f522810f210 0x7f522811d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522de1d6c0 1 -- 10.20.193.70:0/3649563113 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5228115420 msgr2=0x7f522811d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522de1d6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5228115420 0x7f522811d760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522de1d6c0 1 -- 10.20.193.70:0/3649563113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f522810f210 msgr2=0x7f522811d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522de1d6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f522810f210 0x7f522811d220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522de1d6c0 1 -- 10.20.193.70:0/3649563113 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52180094c0 con 0x7f5228122b20 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522de1d6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5228122b20 0x7f5228122fc0 secure :-1 s=READY pgs=283 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f522400c9b0 tx=0x7f522400ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f52167fc6c0 1 -- 10.20.193.70:0/3649563113 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5224003c40 con 0x7f5228122b20 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522f8ab6c0 1 -- 10.20.193.70:0/3649563113 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5228163d10 con 0x7f5228122b20 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f52167fc6c0 1 -- 10.20.193.70:0/3649563113 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f522400a070 con 0x7f5228122b20 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f52167fc6c0 1 -- 10.20.193.70:0/3649563113 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f52240081c0 con 0x7f5228122b20 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.493+0000 7f522f8ab6c0 1 -- 10.20.193.70:0/3649563113 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52281641f0 con 0x7f5228122b20 2026-02-13T03:45:34.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.494+0000 7f51f7fff6c0 1 -- 10.20.193.70:0/3649563113 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ec005310 con 0x7f5228122b20 2026-02-13T03:45:34.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.496+0000 7f52167fc6c0 1 -- 10.20.193.70:0/3649563113 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f5224005030 con 0x7f5228122b20 2026-02-13T03:45:34.499 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f52167fc6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f52040b5710 0x7f52040d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.500 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f52167fc6c0 1 -- 10.20.193.70:0/3649563113 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f52240e4a20 con 0x7f5228122b20 2026-02-13T03:45:34.500 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f94421a46c0 1 -- 10.20.193.70:0/2459578302 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c1131c0 msgr2=0x7f943c173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.500 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f94421a46c0 1 --2- 10.20.193.70:0/2459578302 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c1131c0 0x7f943c173b60 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=5197350817280174309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943000aa70 tx=0x7f943002fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.500 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f94421a46c0 1 -- 10.20.193.70:0/2459578302 shutdown_connections 2026-02-13T03:45:34.501 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f94421a46c0 1 --2- 10.20.193.70:0/2459578302 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c1131c0 0x7f943c173b60 unknown :-1 s=CLOSED pgs=284 gs=1 cs=0 l=1 c_cookie=5197350817280174309 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.501 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f94421a46c0 1 --2- 10.20.193.70:0/2459578302 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f943c10d9a0 0x7f943c1129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.501 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f94421a46c0 1 --2- 10.20.193.70:0/2459578302 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f943c10cfb0 0x7f943c10d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.501 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f94421a46c0 1 -- 10.20.193.70:0/2459578302 >> 10.20.193.70:0/2459578302 conn(0x7f943c0ea8b0 msgr2=0x7f943c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.501 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f94421a46c0 1 -- 10.20.193.70:0/2459578302 shutdown_connections 2026-02-13T03:45:34.501 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f94421a46c0 1 -- 10.20.193.70:0/2459578302 wait complete. 2026-02-13T03:45:34.501 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.497+0000 7f52167fc6c0 1 -- 10.20.193.70:0/3649563113 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f52240aa450 con 0x7f5228122b20 2026-02-13T03:45:34.503 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.498+0000 7f94421a46c0 1 Processor -- start 2026-02-13T03:45:34.503 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.498+0000 7f94421a46c0 1 -- start start 2026-02-13T03:45:34.503 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.498+0000 7f94421a46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c10cfb0 0x7f943c11af50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.503 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.498+0000 7f94421a46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f943c1131c0 0x7f943c11b490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.503 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f94421a46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f943c120850 0x7f943c120cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.503 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943b7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c10cfb0 0x7f943c11af50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.503 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f94421a46c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f943c121260 con 0x7f943c10cfb0 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f94421a46c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f943c1213d0 con 0x7f943c120850 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f94421a46c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f943c121590 con 0x7f943c1131c0 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943b7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c10cfb0 0x7f943c11af50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34092/0 (socket says 10.20.193.70:34092) 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943b7fe6c0 1 -- 10.20.193.70:0/1432892631 learned_addr learned my addr 10.20.193.70:0/1432892631 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943bfff6c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f943c120850 0x7f943c120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943b7fe6c0 1 -- 10.20.193.70:0/1432892631 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f943c1131c0 msgr2=0x7f943c11b490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943b7fe6c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f943c1131c0 0x7f943c11b490 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943b7fe6c0 1 -- 10.20.193.70:0/1432892631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f943c120850 msgr2=0x7f943c120cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943b7fe6c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f943c120850 0x7f943c120cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.504 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943b7fe6c0 1 -- 10.20.193.70:0/1432892631 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943000a660 con 0x7f943c10cfb0 2026-02-13T03:45:34.505 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943bfff6c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f943c120850 0x7f943c120cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:34.505 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f943b7fe6c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c10cfb0 0x7f943c11af50 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f942800b710 tx=0x7f942800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.505 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f9438ff96c0 1 -- 10.20.193.70:0/1432892631 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9428004250 con 0x7f943c10cfb0 2026-02-13T03:45:34.505 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f9438ff96c0 1 -- 10.20.193.70:0/1432892631 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9428009070 con 0x7f943c10cfb0 2026-02-13T03:45:34.505 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f9438ff96c0 1 -- 10.20.193.70:0/1432892631 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f942800ccd0 con 0x7f943c10cfb0 2026-02-13T03:45:34.505 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943c161a40 con 0x7f943c10cfb0 2026-02-13T03:45:34.505 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.499+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943c161ed0 con 0x7f943c10cfb0 2026-02-13T03:45:34.505 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.500+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f943c10e280 con 0x7f943c10cfb0 2026-02-13T03:45:34.506 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.502+0000 7f9438ff96c0 1 -- 10.20.193.70:0/1432892631 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f94280028c0 con 0x7f943c10cfb0 2026-02-13T03:45:34.506 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.503+0000 7f9438ff96c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94100b5710 0x7f94100d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.506 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.503+0000 7f9438ff96c0 1 -- 10.20.193.70:0/1432892631 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f94280e3c20 con 0x7f943c10cfb0 2026-02-13T03:45:34.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.504+0000 7fbee70186c0 1 -- 10.20.193.70:0/4280393398 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 msgr2=0x7fbee010d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.504+0000 7fbee70186c0 1 --2- 10.20.193.70:0/4280393398 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 0x7fbee010d380 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=6141726603489899320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed00099a0 tx=0x7fbed002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.504+0000 7fbee70186c0 1 -- 10.20.193.70:0/4280393398 shutdown_connections 2026-02-13T03:45:34.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.504+0000 7fbee70186c0 1 --2- 10.20.193.70:0/4280393398 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbee01131c0 0x7fbee0173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.504+0000 7fbee70186c0 1 --2- 10.20.193.70:0/4280393398 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee010d9a0 0x7fbee01129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.504+0000 7fbee70186c0 1 --2- 10.20.193.70:0/4280393398 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 0x7fbee010d380 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=6141726603489899320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.504+0000 7fbee70186c0 1 -- 10.20.193.70:0/4280393398 >> 10.20.193.70:0/4280393398 conn(0x7fbee00ea8b0 msgr2=0x7fbee010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.504+0000 7fbee70186c0 1 -- 10.20.193.70:0/4280393398 shutdown_connections 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.504+0000 7fbee70186c0 1 -- 10.20.193.70:0/4280393398 wait complete. 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee70186c0 1 Processor -- start 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee70186c0 1 -- start start 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee70186c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 0x7fbee0060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee70186c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee01131c0 0x7fbee0060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee70186c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbee0061180 0x7fbee0163250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee70186c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0163790 con 0x7fbee0061180 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee70186c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0163900 con 0x7fbee01131c0 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee70186c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0163ac0 con 0x7fbee010cfb0 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee4d8d6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 0x7fbee0060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.509 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee558e6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbee0061180 0x7fbee0163250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee4d8d6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 0x7fbee0060700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:57044/0 (socket says 10.20.193.70:57044) 2026-02-13T03:45:34.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee4d8d6c0 1 -- 10.20.193.70:0/752622430 learned_addr learned my addr 10.20.193.70:0/752622430 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7f9438ff96c0 1 -- 10.20.193.70:0/1432892631 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f94280a6680 con 0x7f943c10cfb0 2026-02-13T03:45:34.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbed7fff6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee01131c0 0x7fbee0060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee4d8d6c0 1 -- 10.20.193.70:0/752622430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee01131c0 msgr2=0x7fbee0060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee4d8d6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee01131c0 0x7fbee0060c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee4d8d6c0 1 -- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbee0061180 msgr2=0x7fbee0163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee4d8d6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbee0061180 0x7fbee0163250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee4d8d6c0 1 -- 10.20.193.70:0/752622430 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc00a5b0 con 0x7fbee010cfb0 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.505+0000 7fbee558e6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbee0061180 0x7fbee0163250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.506+0000 7fbee4d8d6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 0x7fbee0060700 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed002f230 tx=0x7fbed002fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.506+0000 7fbed5ffb6c0 1 -- 10.20.193.70:0/752622430 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed0002ae0 con 0x7fbee010cfb0 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.506+0000 7fbed5ffb6c0 1 -- 10.20.193.70:0/752622430 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbed0002c40 con 0x7fbee010cfb0 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.506+0000 7fbed5ffb6c0 1 -- 10.20.193.70:0/752622430 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbed00362f0 con 0x7fbee010cfb0 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.506+0000 7fbee70186c0 1 -- 10.20.193.70:0/752622430 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed0009590 con 0x7fbee010cfb0 2026-02-13T03:45:34.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.506+0000 7fbee70186c0 1 -- 10.20.193.70:0/752622430 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee0163fe0 con 0x7fbee010cfb0 2026-02-13T03:45:34.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.506+0000 7fbeaf7fe6c0 1 -- 10.20.193.70:0/752622430 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea0005310 con 0x7fbee010cfb0 2026-02-13T03:45:34.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.507+0000 7fbed5ffb6c0 1 -- 10.20.193.70:0/752622430 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fbed00071c0 con 0x7fbee010cfb0 2026-02-13T03:45:34.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.508+0000 7fbed5ffb6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbebc0b5710 0x7fbebc0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.508+0000 7fbed5ffb6c0 1 -- 10.20.193.70:0/752622430 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fbed0107bd0 con 0x7fbee010cfb0 2026-02-13T03:45:34.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.509+0000 7fbed7fff6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbebc0b5710 0x7fbebc0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.509+0000 7f522d61c6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f52040b5710 0x7f52040d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.514 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.509+0000 7f943affd6c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94100b5710 0x7f94100d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.514 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.509+0000 7f943affd6c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94100b5710 0x7f94100d5bc0 secure :-1 s=READY pgs=203 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943c1218e0 tx=0x7f942c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.514 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.509+0000 7f522d61c6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f52040b5710 0x7f52040d5bc0 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52180097f0 tx=0x7f52180023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.515 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.509+0000 7fbed7fff6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbebc0b5710 0x7fbebc0d5bc0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee010b7d0 tx=0x7fbec8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.515 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.510+0000 7fbed5ffb6c0 1 -- 10.20.193.70:0/752622430 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbed00ca5f0 con 0x7fbee010cfb0 2026-02-13T03:45:34.515 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.511+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3039911976 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f98b0153420 msgr2=0x7f98b0173800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.515 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.511+0000 7f98b5e396c0 1 --2- 10.20.193.70:0/3039911976 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f98b0153420 0x7f98b0173800 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=10315219567569296181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98a400aa40 tx=0x7f98a402fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.516 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.514+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3039911976 shutdown_connections 2026-02-13T03:45:34.516 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.514+0000 7f98b5e396c0 1 --2- 10.20.193.70:0/3039911976 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f98b0153420 0x7f98b0173800 unknown :-1 s=CLOSED pgs=62 gs=2 cs=0 l=1 c_cookie=10315219567569296181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.516 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.514+0000 7f98b5e396c0 1 --2- 10.20.193.70:0/3039911976 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f98b010bb00 0x7f98b0152ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.516 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.514+0000 7f98b5e396c0 1 --2- 10.20.193.70:0/3039911976 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f98b010b1f0 0x7f98b010b5c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.516 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.514+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3039911976 >> 10.20.193.70:0/3039911976 conn(0x7f98b0063af0 msgr2=0x7f98b00642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.516 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.514+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3039911976 shutdown_connections 2026-02-13T03:45:34.516 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.514+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3039911976 wait complete. 2026-02-13T03:45:34.518 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.514+0000 7f98b5e396c0 1 Processor -- start 2026-02-13T03:45:34.518 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98b5e396c0 1 -- start start 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98b5e396c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f98b010b1f0 0x7f98b015f1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98b5e396c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f98b010bb00 0x7f98b015f6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98aeffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f98b010bb00 0x7f98b015f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98aeffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f98b010bb00 0x7f98b015f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34120/0 (socket says 10.20.193.70:34120) 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98af7fe6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f98b010b1f0 0x7f98b015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98af7fe6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f98b010b1f0 0x7f98b015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:57094/0 (socket says 10.20.193.70:57094) 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98aeffd6c0 1 -- 10.20.193.70:0/3088467833 learned_addr learned my addr 10.20.193.70:0/3088467833 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98b5e396c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f98b0153420 0x7f98b0164aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3088467833 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f98b01650f0 con 0x7f98b010bb00 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3088467833 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f98b0165260 con 0x7f98b010b1f0 2026-02-13T03:45:34.519 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.515+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3088467833 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f98b0165420 con 0x7f98b0153420 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98affff6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f98b0153420 0x7f98b0164aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98aeffd6c0 1 -- 10.20.193.70:0/3088467833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f98b0153420 msgr2=0x7f98b0164aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98aeffd6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f98b0153420 0x7f98b0164aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98aeffd6c0 1 -- 10.20.193.70:0/3088467833 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f98b010b1f0 msgr2=0x7f98b015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98aeffd6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f98b010b1f0 0x7f98b015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98aeffd6c0 1 -- 10.20.193.70:0/3088467833 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a00094c0 con 0x7f98b010bb00 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98affff6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f98b0153420 0x7f98b0164aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98aeffd6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f98b010bb00 0x7f98b015f6e0 secure :-1 s=READY pgs=286 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98a0009fd0 tx=0x7f98a000bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98acff96c0 1 -- 10.20.193.70:0/3088467833 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f98a0004290 con 0x7f98b010bb00 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98acff96c0 1 -- 10.20.193.70:0/3088467833 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f98a0009030 con 0x7f98b010bb00 2026-02-13T03:45:34.520 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98acff96c0 1 -- 10.20.193.70:0/3088467833 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f98a00071c0 con 0x7f98b010bb00 2026-02-13T03:45:34.521 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3088467833 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a400a660 con 0x7f98b010bb00 2026-02-13T03:45:34.521 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.516+0000 7f98b5e396c0 1 -- 10.20.193.70:0/3088467833 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b014eea0 con 0x7f98b010bb00 2026-02-13T03:45:34.522 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.518+0000 7f988a7fc6c0 1 -- 10.20.193.70:0/3088467833 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9878005310 con 0x7f98b010bb00 2026-02-13T03:45:34.522 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.519+0000 7f98acff96c0 1 -- 10.20.193.70:0/3088467833 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f98a000c900 con 0x7f98b010bb00 2026-02-13T03:45:34.522 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.519+0000 7f98acff96c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f98840b5710 0x7f98840d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.522 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.520+0000 7f98af7fe6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f98840b5710 0x7f98840d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.522 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.520+0000 7f98acff96c0 1 -- 10.20.193.70:0/3088467833 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f98a00e3d80 con 0x7f98b010bb00 2026-02-13T03:45:34.522 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.520+0000 7f98af7fe6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f98840b5710 0x7f98840d5bc0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f989c004750 tx=0x7f989c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.523 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.521+0000 7f98acff96c0 1 -- 10.20.193.70:0/3088467833 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f98a00a67a0 con 0x7f98b010bb00 2026-02-13T03:45:34.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.542+0000 7fb3605186c0 1 -- 10.20.193.70:0/1378600821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb35810f230 msgr2=0x7fb35810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7fb3605186c0 1 --2- 10.20.193.70:0/1378600821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb35810f230 0x7fb35810f600 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=3055449688110107570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb348009970 tx=0x7fb34802ed10 comp rx=0 tx=0).stop 2026-02-13T03:45:34.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7fb3605186c0 1 -- 10.20.193.70:0/1378600821 shutdown_connections 2026-02-13T03:45:34.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7fb3605186c0 1 --2- 10.20.193.70:0/1378600821 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb358115440 0x7fb358175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7fb3605186c0 1 --2- 10.20.193.70:0/1378600821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb35810fc20 0x7fb358114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7fb3605186c0 1 --2- 10.20.193.70:0/1378600821 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb35810f230 0x7fb35810f600 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=3055449688110107570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7fb3605186c0 1 -- 10.20.193.70:0/1378600821 >> 10.20.193.70:0/1378600821 conn(0x7fb3580ecb30 msgr2=0x7fb35810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.546 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7fb3605186c0 1 -- 10.20.193.70:0/1378600821 shutdown_connections 2026-02-13T03:45:34.546 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7fb3605186c0 1 -- 10.20.193.70:0/1378600821 wait complete. 2026-02-13T03:45:34.546 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/1619995511 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6cc01198f0 msgr2=0x7f6cc017a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/1619995511 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6cc01198f0 0x7f6cc017a2c0 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=51946240650884433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cbc00aa40 tx=0x7f6cbc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/1619995511 shutdown_connections 2026-02-13T03:45:34.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/1619995511 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6cc01198f0 0x7f6cc017a2c0 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=51946240650884433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/1619995511 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cc0114190 0x7f6cc0119140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/1619995511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cc01137a0 0x7f6cc0113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/1619995511 >> 10.20.193.70:0/1619995511 conn(0x7f6cc0060760 msgr2=0x7f6cc0060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/1619995511 shutdown_connections 2026-02-13T03:45:34.548 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7fb3605186c0 1 Processor -- start 2026-02-13T03:45:34.548 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb3605186c0 1 -- start start 2026-02-13T03:45:34.548 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.543+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/1619995511 wait complete. 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb3605186c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb35810f230 0x7fb35811d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb3605186c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb358115440 0x7fb35811d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35e2896c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb35810f230 0x7fb35811d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb3605186c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb358122b50 0x7fb358122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb3605186c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb358123560 con 0x7fb35810f230 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb3605186c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb3581236d0 con 0x7fb358115440 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb3605186c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb358123890 con 0x7fb358122b50 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35e2896c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb35810f230 0x7fb35811d250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34144/0 (socket says 10.20.193.70:34144) 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35e2896c0 1 -- 10.20.193.70:0/2187924392 learned_addr learned my addr 10.20.193.70:0/2187924392 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.550 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35ea8a6c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb358122b50 0x7fb358122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.551 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35da886c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb358115440 0x7fb35811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.551 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7f6cc701c6c0 1 Processor -- start 2026-02-13T03:45:34.551 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7f6cc701c6c0 1 -- start start 2026-02-13T03:45:34.552 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35e2896c0 1 -- 10.20.193.70:0/2187924392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb358122b50 msgr2=0x7fb358122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.552 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35e2896c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb358122b50 0x7fb358122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.552 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35e2896c0 1 -- 10.20.193.70:0/2187924392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb358115440 msgr2=0x7fb35811d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.552 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35e2896c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb358115440 0x7fb35811d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.552 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35e2896c0 1 -- 10.20.193.70:0/2187924392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35400a5b0 con 0x7fb35810f230 2026-02-13T03:45:34.552 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.544+0000 7fb35ea8a6c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb358122b50 0x7fb358122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:34.553 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc701c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cc01137a0 0x7f6cc01216f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.553 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc701c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cc01198f0 0x7f6cc0121c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.553 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc701c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6cc0126ff0 0x7f6cc0127490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.553 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc701c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0127a00 con 0x7f6cc0126ff0 2026-02-13T03:45:34.553 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc701c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0127b70 con 0x7f6cc01198f0 2026-02-13T03:45:34.553 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc701c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0127d30 con 0x7f6cc01137a0 2026-02-13T03:45:34.554 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7fb35e2896c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb35810f230 0x7fb35811d250 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3480098c0 tx=0x7fb34802fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.554 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc55926c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6cc0126ff0 0x7f6cc0127490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.554 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cb7fff6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cc01198f0 0x7f6cc0121c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.554 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cb7fff6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cc01198f0 0x7f6cc0121c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:57132/0 (socket says 10.20.193.70:57132) 2026-02-13T03:45:34.554 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cb7fff6c0 1 -- 10.20.193.70:0/3767599514 learned_addr learned my addr 10.20.193.70:0/3767599514 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.555 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc4d916c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cc01137a0 0x7f6cc01216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.555 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc55926c0 1 -- 10.20.193.70:0/3767599514 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cc01137a0 msgr2=0x7f6cc01216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.555 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc55926c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cc01137a0 0x7f6cc01216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.555 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc55926c0 1 -- 10.20.193.70:0/3767599514 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cc01198f0 msgr2=0x7f6cc0121c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.555 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc55926c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cc01198f0 0x7f6cc0121c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.555 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc55926c0 1 -- 10.20.193.70:0/3767599514 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cbc00a660 con 0x7f6cc0126ff0 2026-02-13T03:45:34.555 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cb7fff6c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cc01198f0 0x7f6cc0121c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:45:34.556 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7fb33f7fe6c0 1 -- 10.20.193.70:0/2187924392 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb348002ae0 con 0x7fb35810f230 2026-02-13T03:45:34.556 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7fb33f7fe6c0 1 -- 10.20.193.70:0/2187924392 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb348002c40 con 0x7fb35810f230 2026-02-13T03:45:34.556 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7fb33f7fe6c0 1 -- 10.20.193.70:0/2187924392 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3480372f0 con 0x7fb35810f230 2026-02-13T03:45:34.556 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7fb3605186c0 1 -- 10.20.193.70:0/2187924392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb348009590 con 0x7fb35810f230 2026-02-13T03:45:34.556 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7fb3605186c0 1 -- 10.20.193.70:0/2187924392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb358163f50 con 0x7fb35810f230 2026-02-13T03:45:34.556 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.545+0000 7f6cc55926c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6cc0126ff0 0x7f6cc0127490 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cbc00aa40 tx=0x7f6cbc0054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.546+0000 7fb33d7fa6c0 1 -- 10.20.193.70:0/2187924392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb324005310 con 0x7fb35810f230 2026-02-13T03:45:34.557 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.546+0000 7f6cb5ffb6c0 1 -- 10.20.193.70:0/3767599514 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cbc003a30 con 0x7f6cc0126ff0 2026-02-13T03:45:34.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.546+0000 7f6cb5ffb6c0 1 -- 10.20.193.70:0/3767599514 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6cbc003b90 con 0x7f6cc0126ff0 2026-02-13T03:45:34.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.546+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc0168180 con 0x7f6cc0126ff0 2026-02-13T03:45:34.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.546+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc01684f0 con 0x7f6cc0126ff0 2026-02-13T03:45:34.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.546+0000 7f6cb5ffb6c0 1 -- 10.20.193.70:0/3767599514 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6cbc0372f0 con 0x7f6cc0126ff0 2026-02-13T03:45:34.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.548+0000 7fb33f7fe6c0 1 -- 10.20.193.70:0/2187924392 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fb348007810 con 0x7fb35810f230 2026-02-13T03:45:34.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.548+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc01149e0 con 0x7f6cc0126ff0 2026-02-13T03:45:34.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.548+0000 7fb33f7fe6c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3340b57e0 0x7fb3340d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.549+0000 7f6cb5ffb6c0 1 -- 10.20.193.70:0/3767599514 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f6cbc008260 con 0x7f6cc0126ff0 2026-02-13T03:45:34.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.549+0000 7fb33f7fe6c0 1 -- 10.20.193.70:0/2187924392 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fb348107c10 con 0x7fb35810f230 2026-02-13T03:45:34.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.549+0000 7fb33f7fe6c0 1 -- 10.20.193.70:0/2187924392 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb3480ca670 con 0x7fb35810f230 2026-02-13T03:45:34.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.549+0000 7fb35da886c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3340b57e0 0x7fb3340d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.549+0000 7fb35da886c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3340b57e0 0x7fb3340d5c90 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb358123be0 tx=0x7fb34c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.549+0000 7f6cb5ffb6c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6c9c0b5860 0x7f6c9c0d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.549+0000 7f6cb5ffb6c0 1 -- 10.20.193.70:0/3767599514 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f6cbc108ce0 con 0x7f6cc0126ff0 2026-02-13T03:45:34.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.550+0000 7f6cc4d916c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6c9c0b5860 0x7f6c9c0d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.550+0000 7f6cc4d916c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6c9c0b5860 0x7f6c9c0d5d10 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cb0004750 tx=0x7f6cb0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.551+0000 7f6cb5ffb6c0 1 -- 10.20.193.70:0/3767599514 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6cbc0cb700 con 0x7f6cc0126ff0 2026-02-13T03:45:34.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.551+0000 7f286979c6c0 1 -- 10.20.193.70:0/550317116 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f286410d9a0 msgr2=0x7f28641129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.552+0000 7f286979c6c0 1 --2- 10.20.193.70:0/550317116 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f286410d9a0 0x7f28641129e0 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=16339104561909099876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f284c0099a0 tx=0x7f284c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 -- 10.20.193.70:0/550317116 shutdown_connections 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 --2- 10.20.193.70:0/550317116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28641131c0 0x7f2864173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 --2- 10.20.193.70:0/550317116 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f286410d9a0 0x7f28641129e0 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=16339104561909099876 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 --2- 10.20.193.70:0/550317116 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f286410cfb0 0x7f286410d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 -- 10.20.193.70:0/550317116 >> 10.20.193.70:0/550317116 conn(0x7f28640ea8b0 msgr2=0x7f286410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 -- 10.20.193.70:0/550317116 shutdown_connections 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 -- 10.20.193.70:0/550317116 wait complete. 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 Processor -- start 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 -- start start 2026-02-13T03:45:34.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.554+0000 7f286979c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f286410cfb0 0x7f28640f2980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f286979c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28641131c0 0x7f2864173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f286979c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28640f2fb0 0x7f28640f8280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f2862ffd6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f286410cfb0 0x7f28640f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f2862ffd6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f286410cfb0 0x7f28640f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:57152/0 (socket says 10.20.193.70:57152) 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f28637fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28640f2fb0 0x7f28640f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f28637fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28640f2fb0 0x7f28640f8280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34158/0 (socket says 10.20.193.70:34158) 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f28627fc6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28641131c0 0x7f2864173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f28627fc6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28641131c0 0x7f2864173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:57108/0 (socket says 10.20.193.70:57108) 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f2862ffd6c0 1 -- 10.20.193.70:0/2600580241 learned_addr learned my addr 10.20.193.70:0/2600580241 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28640f36a0 con 0x7f28640f2fb0 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f28640f87c0 con 0x7f286410cfb0 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.555+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f28640f8980 con 0x7f28641131c0 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f28637fe6c0 1 -- 10.20.193.70:0/2600580241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28641131c0 msgr2=0x7f2864173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f28637fe6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28641131c0 0x7f2864173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f28637fe6c0 1 -- 10.20.193.70:0/2600580241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f286410cfb0 msgr2=0x7f28640f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f28637fe6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f286410cfb0 0x7f28640f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f28637fe6c0 1 -- 10.20.193.70:0/2600580241 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c009590 con 0x7f28640f2fb0 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f28637fe6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28640f2fb0 0x7f28640f8280 secure :-1 s=READY pgs=291 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f285400c6c0 tx=0x7f285400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f2843fff6c0 1 -- 10.20.193.70:0/2600580241 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28540054a0 con 0x7f28640f2fb0 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f2843fff6c0 1 -- 10.20.193.70:0/2600580241 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f285400a030 con 0x7f28640f2fb0 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28640f8c60 con 0x7f28640f2fb0 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28640f93f0 con 0x7f28640f2fb0 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.557+0000 7f2843fff6c0 1 -- 10.20.193.70:0/2600580241 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f285400db50 con 0x7f28640f2fb0 2026-02-13T03:45:34.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.558+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28640f9140 con 0x7f28640f2fb0 2026-02-13T03:45:34.568 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.558+0000 7f56cdffb6c0 1 -- 10.20.193.70:0/476857168 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f56b8005890 con 0x7f56f010f230 2026-02-13T03:45:34.568 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.559+0000 7f56cffff6c0 1 -- 10.20.193.70:0/476857168 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f56e40a9580 con 0x7f56f010f230 2026-02-13T03:45:34.568 INFO:teuthology.orchestra.run.trial070.stdout:124554051600 2026-02-13T03:45:34.568 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.559+0000 7f2843fff6c0 1 -- 10.20.193.70:0/2600580241 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f285400dd20 con 0x7f28640f2fb0 2026-02-13T03:45:34.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.559+0000 7fc939ffb6c0 1 -- 10.20.193.70:0/2749836711 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc92c030e50 con 0x7fc93c115440 2026-02-13T03:45:34.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.559+0000 7fc9415606c0 1 -- 10.20.193.70:0/2749836711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 msgr2=0x7fc93c175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.559+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2749836711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 0x7fc93c175de0 secure :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=17009641797772751157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc92c00aa70 tx=0x7fc92c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.559+0000 7fc9415606c0 1 -- 10.20.193.70:0/2749836711 shutdown_connections 2026-02-13T03:45:34.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.559+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2749836711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 0x7fc93c175de0 unknown :-1 s=CLOSED pgs=63 gs=2 cs=0 l=1 c_cookie=17009641797772751157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.559+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2749836711 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc93c10fc20 0x7fc93c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.559+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2749836711 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc93c10f230 0x7fc93c10f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.560+0000 7fc9415606c0 1 -- 10.20.193.70:0/2749836711 >> 10.20.193.70:0/2749836711 conn(0x7fc93c0ecb30 msgr2=0x7fc93c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.560+0000 7fc9415606c0 1 -- 10.20.193.70:0/2749836711 shutdown_connections 2026-02-13T03:45:34.570 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.560+0000 7fc9415606c0 1 -- 10.20.193.70:0/2749836711 wait complete. 2026-02-13T03:45:34.570 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.560+0000 7fc9415606c0 1 Processor -- start 2026-02-13T03:45:34.570 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.560+0000 7f2843fff6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28380b5710 0x7f28380d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.570 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.560+0000 7f2862ffd6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28380b5710 0x7f28380d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.570 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.560+0000 7f2843fff6c0 1 -- 10.20.193.70:0/2600580241 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f28540e47b0 con 0x7f28640f2fb0 2026-02-13T03:45:34.570 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.560+0000 7fc9415606c0 1 -- start start 2026-02-13T03:45:34.571 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f2862ffd6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28380b5710 0x7f28380d5bc0 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2858009260 tx=0x7f2858009440 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.571 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f2843fff6c0 1 -- 10.20.193.70:0/2600580241 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f28540a7210 con 0x7f28640f2fb0 2026-02-13T03:45:34.571 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7fc9415606c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc93c10f230 0x7fc93c0fe310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.571 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7fc9415606c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 0x7fc93c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.572 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7fc9415606c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc93c0fe850 0x7fc93c0fecf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.572 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7fc9415606c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c103360 con 0x7fc93c10f230 2026-02-13T03:45:34.572 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7fc9415606c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1034d0 con 0x7fc93c0fe850 2026-02-13T03:45:34.572 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7fc9415606c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c103690 con 0x7fc93c115440 2026-02-13T03:45:34.572 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 -- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f56c40b5690 msgr2=0x7f56c40d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.572 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f56c40b5690 0x7f56c40d5b40 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56f01804a0 tx=0x7f56d8009310 comp rx=0 tx=0).stop 2026-02-13T03:45:34.572 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 -- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f56f010f230 msgr2=0x7f56f017d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.572 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f56f010f230 0x7f56f017d9a0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e400b6c0 tx=0x7f56e400bb90 comp rx=0 tx=0).stop 2026-02-13T03:45:34.573 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7fc93a7fc6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 0x7fc93c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.573 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7fc93a7fc6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 0x7fc93c175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:57150/0 (socket says 10.20.193.70:57150) 2026-02-13T03:45:34.573 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7fc93a7fc6c0 1 -- 10.20.193.70:0/2048791524 learned_addr learned my addr 10.20.193.70:0/2048791524 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.573 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 -- 10.20.193.70:0/476857168 shutdown_connections 2026-02-13T03:45:34.573 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f56c40b5690 0x7f56c40d5b40 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56f017dee0 0x7f56f017e380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f56f0115440 0x7f56f0175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 --2- 10.20.193.70:0/476857168 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f56f010f230 0x7f56f017d9a0 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.561+0000 7f56cdffb6c0 1 -- 10.20.193.70:0/476857168 >> 10.20.193.70:0/476857168 conn(0x7f56f00ecb30 msgr2=0x7f56f010d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc93a7fc6c0 1 -- 10.20.193.70:0/2048791524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc93c0fe850 msgr2=0x7fc93c0fecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc93b7fe6c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc93c0fe850 0x7fc93c0fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc93a7fc6c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc93c0fe850 0x7fc93c0fecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc93a7fc6c0 1 -- 10.20.193.70:0/2048791524 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc93c10f230 msgr2=0x7fc93c0fe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc93a7fc6c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc93c10f230 0x7fc93c0fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc93a7fc6c0 1 -- 10.20.193.70:0/2048791524 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c00a660 con 0x7fc93c115440 2026-02-13T03:45:34.574 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc93b7fe6c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc93c0fe850 0x7fc93c0fecf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:34.575 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f56cdffb6c0 1 -- 10.20.193.70:0/476857168 shutdown_connections 2026-02-13T03:45:34.575 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f56cdffb6c0 1 -- 10.20.193.70:0/476857168 wait complete. 2026-02-13T03:45:34.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 -- 10.20.193.70:0/3420511651 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764010f230 msgr2=0x7f764010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 --2- 10.20.193.70:0/3420511651 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764010f230 0x7f764010f600 secure :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=16621926587690728676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630009970 tx=0x7f763002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 -- 10.20.193.70:0/3420511651 shutdown_connections 2026-02-13T03:45:34.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 --2- 10.20.193.70:0/3420511651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7640115440 0x7f7640175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 --2- 10.20.193.70:0/3420511651 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f764010fc20 0x7f7640114c60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 --2- 10.20.193.70:0/3420511651 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f764010f230 0x7f764010f600 unknown :-1 s=CLOSED pgs=56 gs=2 cs=0 l=1 c_cookie=16621926587690728676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 -- 10.20.193.70:0/3420511651 >> 10.20.193.70:0/3420511651 conn(0x7f76400ecb30 msgr2=0x7f764010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 -- 10.20.193.70:0/3420511651 shutdown_connections 2026-02-13T03:45:34.576 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 -- 10.20.193.70:0/3420511651 wait complete. 2026-02-13T03:45:34.577 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc93a7fc6c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 0x7fc93c175ce0 secure :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc92400b800 tx=0x7fc92400bcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.577 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc91bfff6c0 1 -- 10.20.193.70:0/2048791524 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc924004a80 con 0x7fc93c115440 2026-02-13T03:45:34.577 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc91bfff6c0 1 -- 10.20.193.70:0/2048791524 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc924009070 con 0x7fc93c115440 2026-02-13T03:45:34.577 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c103970 con 0x7fc93c115440 2026-02-13T03:45:34.577 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7f76477376c0 1 Processor -- start 2026-02-13T03:45:34.577 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc91bfff6c0 1 -- 10.20.193.70:0/2048791524 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc92400cdd0 con 0x7fc93c115440 2026-02-13T03:45:34.577 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.562+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c103e50 con 0x7fc93c115440 2026-02-13T03:45:34.578 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76477376c0 1 -- start start 2026-02-13T03:45:34.578 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76477376c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f764010f230 0x7f764011d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.578 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76477376c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7640115440 0x7f764011d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.578 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76477376c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7640122ad0 0x7f7640122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76477376c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f76401234e0 con 0x7f7640122ad0 2026-02-13T03:45:34.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76477376c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7640123650 con 0x7f7640115440 2026-02-13T03:45:34.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76477376c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7640123810 con 0x7f764010f230 2026-02-13T03:45:34.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f7644ca76c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7640115440 0x7f764011d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f7644ca76c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7640115440 0x7f764011d710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:57200/0 (socket says 10.20.193.70:57200) 2026-02-13T03:45:34.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f7644ca76c0 1 -- 10.20.193.70:0/1700034426 learned_addr learned my addr 10.20.193.70:0/1700034426 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:34.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76454a86c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f764010f230 0x7f764011d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93c110500 con 0x7fc93c115440 2026-02-13T03:45:34.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76454a86c0 1 -- 10.20.193.70:0/1700034426 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7640115440 msgr2=0x7f764011d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76454a86c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7640115440 0x7f764011d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76454a86c0 1 -- 10.20.193.70:0/1700034426 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7640122ad0 msgr2=0x7f7640122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76454a86c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7640122ad0 0x7f7640122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76454a86c0 1 -- 10.20.193.70:0/1700034426 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7630009590 con 0x7f764010f230 2026-02-13T03:45:34.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f7644ca76c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7640115440 0x7f764011d710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:45:34.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.563+0000 7f76454a86c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f764010f230 0x7f764011d1d0 secure :-1 s=READY pgs=65 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630009970 tx=0x7f763002fa50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.564+0000 7fc91bfff6c0 1 -- 10.20.193.70:0/2048791524 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fc924004060 con 0x7fc93c115440 2026-02-13T03:45:34.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.564+0000 7f762e7fc6c0 1 -- 10.20.193.70:0/1700034426 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7630004560 con 0x7f764010f230 2026-02-13T03:45:34.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.564+0000 7f762e7fc6c0 1 -- 10.20.193.70:0/1700034426 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7630002cf0 con 0x7f764010f230 2026-02-13T03:45:34.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.564+0000 7f762e7fc6c0 1 -- 10.20.193.70:0/1700034426 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76300071c0 con 0x7f764010f230 2026-02-13T03:45:34.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.564+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7640163c60 con 0x7f764010f230 2026-02-13T03:45:34.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.564+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7640164090 con 0x7f764010f230 2026-02-13T03:45:34.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.565+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7640110500 con 0x7f764010f230 2026-02-13T03:45:34.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.565+0000 7fc91bfff6c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc9100b5680 0x7fc9100d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.565+0000 7fc93affd6c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc9100b5680 0x7fc9100d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.565+0000 7fc91bfff6c0 1 -- 10.20.193.70:0/2048791524 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fc9240e3b90 con 0x7fc93c115440 2026-02-13T03:45:34.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.565+0000 7fc93affd6c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc9100b5680 0x7fc9100d5b30 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc930004750 tx=0x7fc930006d50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.566+0000 7fc91bfff6c0 1 -- 10.20.193.70:0/2048791524 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc9240a65b0 con 0x7fc93c115440 2026-02-13T03:45:34.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.568+0000 7f762e7fc6c0 1 -- 10.20.193.70:0/1700034426 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f7630002830 con 0x7f764010f230 2026-02-13T03:45:34.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.568+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f68d811e440 con 0x7f68d8115440 2026-02-13T03:45:34.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.568+0000 7f68d4ff96c0 1 -- 10.20.193.70:0/919372343 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f68c80a9610 con 0x7f68d8115440 2026-02-13T03:45:34.583 INFO:teuthology.orchestra.run.trial070.stdout:201863462924 2026-02-13T03:45:34.583 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.569+0000 7f762e7fc6c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f761c0b57e0 0x7f761c0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:34.583 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.569+0000 7f762e7fc6c0 1 -- 10.20.193.70:0/1700034426 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f7630107c90 con 0x7f764010f230 2026-02-13T03:45:34.583 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.569+0000 7f7644ca76c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f761c0b57e0 0x7f761c0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:34.583 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.569+0000 7f762e7fc6c0 1 -- 10.20.193.70:0/1700034426 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7630108180 con 0x7f764010f230 2026-02-13T03:45:34.583 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.569+0000 7f7644ca76c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f761c0b57e0 0x7f761c0d5c90 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7640123b60 tx=0x7f7634006f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f68ac0b5710 msgr2=0x7f68ac0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f68ac0b5710 0x7f68ac0d5bc0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c40097f0 tx=0x7f68c40091a0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68d8115440 msgr2=0x7f68d811d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68d8115440 0x7f68d811d830 secure :-1 s=READY pgs=281 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68c8004750 tx=0x7f68c800bb60 comp rx=0 tx=0).stop 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 shutdown_connections 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f68ac0b5710 0x7f68ac0d5bc0 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68d8122bf0 0x7f68d8123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68d8115440 0x7f68d811d830 unknown :-1 s=CLOSED pgs=281 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 --2- 10.20.193.70:0/919372343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68d810f230 0x7f68d811d2f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 >> 10.20.193.70:0/919372343 conn(0x7f68d80ecb30 msgr2=0x7f68d810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.571+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 shutdown_connections 2026-02-13T03:45:34.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.574+0000 7f68ddf176c0 1 -- 10.20.193.70:0/919372343 wait complete. 2026-02-13T03:45:34.585 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.577+0000 7f16d17fa6c0 1 -- 10.20.193.70:0/254571819 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f16b4005890 con 0x7f16e81131c0 2026-02-13T03:45:34.585 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.577+0000 7f16d37fe6c0 1 -- 10.20.193.70:0/254571819 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f16e00a9320 con 0x7f16e81131c0 2026-02-13T03:45:34.585 INFO:teuthology.orchestra.run.trial070.stdout:111669149712 2026-02-13T03:45:34.585 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.580+0000 7f16d17fa6c0 1 -- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f16c40b5710 msgr2=0x7f16c40d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.585 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.580+0000 7f16d17fa6c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f16c40b5710 0x7f16c40d5bc0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16d4004750 tx=0x7f16d4009260 comp rx=0 tx=0).stop 2026-02-13T03:45:34.585 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.580+0000 7f16d17fa6c0 1 -- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f16e81131c0 msgr2=0x7f16e8173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.585 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.580+0000 7f16d17fa6c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f16e81131c0 0x7f16e8173a60 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16e000b6c0 tx=0x7f16e000bb90 comp rx=0 tx=0).stop 2026-02-13T03:45:34.585 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.581+0000 7f16d17fa6c0 1 -- 10.20.193.70:0/254571819 shutdown_connections 2026-02-13T03:45:34.585 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.581+0000 7f16d17fa6c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f16c40b5710 0x7f16c40d5bc0 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.586 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.581+0000 7f16d17fa6c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f16e80f2f20 0x7f16e80f81f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.586 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.581+0000 7f16d17fa6c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f16e81131c0 0x7f16e8173a60 unknown :-1 s=CLOSED pgs=280 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.586 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.581+0000 7f16d17fa6c0 1 --2- 10.20.193.70:0/254571819 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f16e810cfb0 0x7f16e80f28f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.586 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.581+0000 7f16d17fa6c0 1 -- 10.20.193.70:0/254571819 >> 10.20.193.70:0/254571819 conn(0x7f16e80ea8b0 msgr2=0x7f16e810b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.586 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.581+0000 7f16d17fa6c0 1 -- 10.20.193.70:0/254571819 shutdown_connections 2026-02-13T03:45:34.586 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.581+0000 7f16d17fa6c0 1 -- 10.20.193.70:0/254571819 wait complete. 2026-02-13T03:45:34.612 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.611+0000 7f51f7fff6c0 1 -- 10.20.193.70:0/3649563113 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f51ec005890 con 0x7f5228122b20 2026-02-13T03:45:34.613 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.611+0000 7f52167fc6c0 1 -- 10.20.193.70:0/3649563113 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52240aa630 con 0x7f5228122b20 2026-02-13T03:45:34.613 INFO:teuthology.orchestra.run.trial070.stdout:55834574868 2026-02-13T03:45:34.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 -- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f52040b5710 msgr2=0x7f52040d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f52040b5710 0x7f52040d5bc0 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52180097f0 tx=0x7f52180023a0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 -- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5228122b20 msgr2=0x7f5228122fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5228122b20 0x7f5228122fc0 secure :-1 s=READY pgs=283 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f522400c9b0 tx=0x7f522400ce80 comp rx=0 tx=0).stop 2026-02-13T03:45:34.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 -- 10.20.193.70:0/3649563113 shutdown_connections 2026-02-13T03:45:34.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f52040b5710 0x7f52040d5bc0 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5228122b20 0x7f5228122fc0 unknown :-1 s=CLOSED pgs=283 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5228115420 0x7f522811d760 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 --2- 10.20.193.70:0/3649563113 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f522810f210 0x7f522811d220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 -- 10.20.193.70:0/3649563113 >> 10.20.193.70:0/3649563113 conn(0x7f52280ecb30 msgr2=0x7f522810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 -- 10.20.193.70:0/3649563113 shutdown_connections 2026-02-13T03:45:34.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.614+0000 7f51f7fff6c0 1 -- 10.20.193.70:0/3649563113 wait complete. 2026-02-13T03:45:34.620 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.618+0000 7fbeaf7fe6c0 1 -- 10.20.193.70:0/752622430 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbea00055c0 con 0x7fbee010cfb0 2026-02-13T03:45:34.620 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.618+0000 7fbed5ffb6c0 1 -- 10.20.193.70:0/752622430 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbed00cd7a0 con 0x7fbee010cfb0 2026-02-13T03:45:34.620 INFO:teuthology.orchestra.run.trial070.stdout:154618822670 2026-02-13T03:45:34.621 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.619+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f943c10d9a0 con 0x7f943c10cfb0 2026-02-13T03:45:34.621 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.619+0000 7f9438ff96c0 1 -- 10.20.193.70:0/1432892631 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f942800ce60 con 0x7f943c10cfb0 2026-02-13T03:45:34.621 INFO:teuthology.orchestra.run.trial070.stdout:81604378643 2026-02-13T03:45:34.622 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 -- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbebc0b5710 msgr2=0x7fbebc0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbebc0b5710 0x7fbebc0d5bc0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbee010b7d0 tx=0x7fbec8009260 comp rx=0 tx=0).stop 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 -- 10.20.193.70:0/752622430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 msgr2=0x7fbee0060700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 0x7fbee0060700 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbed002f230 tx=0x7fbed002fc00 comp rx=0 tx=0).stop 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 -- 10.20.193.70:0/752622430 shutdown_connections 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbebc0b5710 0x7fbebc0d5bc0 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbee0061180 0x7fbee0163250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbee01131c0 0x7fbee0060c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 --2- 10.20.193.70:0/752622430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbee010cfb0 0x7fbee0060700 unknown :-1 s=CLOSED pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 -- 10.20.193.70:0/752622430 >> 10.20.193.70:0/752622430 conn(0x7fbee00ea8b0 msgr2=0x7fbee010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 -- 10.20.193.70:0/752622430 shutdown_connections 2026-02-13T03:45:34.623 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.620+0000 7fbeaf7fe6c0 1 -- 10.20.193.70:0/752622430 wait complete. 2026-02-13T03:45:34.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.621+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94100b5710 msgr2=0x7f94100d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.621+0000 7f94421a46c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94100b5710 0x7f94100d5bc0 secure :-1 s=READY pgs=203 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943c1218e0 tx=0x7f942c009260 comp rx=0 tx=0).stop 2026-02-13T03:45:34.624 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.621+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c10cfb0 msgr2=0x7f943c11af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.621+0000 7f94421a46c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c10cfb0 0x7f943c11af50 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f942800b710 tx=0x7f942800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.622+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 shutdown_connections 2026-02-13T03:45:34.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.622+0000 7f94421a46c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94100b5710 0x7f94100d5bc0 unknown :-1 s=CLOSED pgs=203 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.622+0000 7f94421a46c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f943c120850 0x7f943c120cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.622+0000 7f94421a46c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f943c1131c0 0x7f943c11b490 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.622+0000 7f94421a46c0 1 --2- 10.20.193.70:0/1432892631 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f943c10cfb0 0x7f943c11af50 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.622+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 >> 10.20.193.70:0/1432892631 conn(0x7f943c0ea8b0 msgr2=0x7f943c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.622+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 shutdown_connections 2026-02-13T03:45:34.625 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.622+0000 7f94421a46c0 1 -- 10.20.193.70:0/1432892631 wait complete. 2026-02-13T03:45:34.626 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051601 got 124554051600 for osd.5 2026-02-13T03:45:34.641 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.638+0000 7f988a7fc6c0 1 -- 10.20.193.70:0/3088467833 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f98780055c0 con 0x7f98b010bb00 2026-02-13T03:45:34.641 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.639+0000 7f98acff96c0 1 -- 10.20.193.70:0/3088467833 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f98a00a9950 con 0x7f98b010bb00 2026-02-13T03:45:34.641 INFO:teuthology.orchestra.run.trial070.stdout:231928233994 2026-02-13T03:45:34.642 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149713 got 111669149712 for osd.4 2026-02-13T03:45:34.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 -- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f98840b5710 msgr2=0x7f98840d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f98840b5710 0x7f98840d5bc0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f989c004750 tx=0x7f989c009260 comp rx=0 tx=0).stop 2026-02-13T03:45:34.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 -- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f98b010bb00 msgr2=0x7f98b015f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f98b010bb00 0x7f98b015f6e0 secure :-1 s=READY pgs=286 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98a0009fd0 tx=0x7f98a000bc90 comp rx=0 tx=0).stop 2026-02-13T03:45:34.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 -- 10.20.193.70:0/3088467833 shutdown_connections 2026-02-13T03:45:34.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f98840b5710 0x7f98840d5bc0 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f98b0153420 0x7f98b0164aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f98b010bb00 0x7f98b015f6e0 unknown :-1 s=CLOSED pgs=286 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 --2- 10.20.193.70:0/3088467833 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f98b010b1f0 0x7f98b015f1a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 -- 10.20.193.70:0/3088467833 >> 10.20.193.70:0/3088467833 conn(0x7f98b0063af0 msgr2=0x7f98b010a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.641+0000 7f988a7fc6c0 1 -- 10.20.193.70:0/3088467833 shutdown_connections 2026-02-13T03:45:34.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.642+0000 7f988a7fc6c0 1 -- 10.20.193.70:0/3088467833 wait complete. 2026-02-13T03:45:34.646 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462925 got 201863462924 for osd.8 2026-02-13T03:45:34.666 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574869 got 55834574868 for osd.2 2026-02-13T03:45:34.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.664+0000 7fb33d7fa6c0 1 -- 10.20.193.70:0/2187924392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb324005890 con 0x7fb35810f230 2026-02-13T03:45:34.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.665+0000 7fb33f7fe6c0 1 -- 10.20.193.70:0/2187924392 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3480cd820 con 0x7fb35810f230 2026-02-13T03:45:34.667 INFO:teuthology.orchestra.run.trial070.stdout:42949672981 2026-02-13T03:45:34.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 -- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3340b57e0 msgr2=0x7fb3340d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3340b57e0 0x7fb3340d5c90 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb358123be0 tx=0x7fb34c009260 comp rx=0 tx=0).stop 2026-02-13T03:45:34.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 -- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb35810f230 msgr2=0x7fb35811d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb35810f230 0x7fb35811d250 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3480098c0 tx=0x7fb34802fc20 comp rx=0 tx=0).stop 2026-02-13T03:45:34.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 -- 10.20.193.70:0/2187924392 shutdown_connections 2026-02-13T03:45:34.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb3340b57e0 0x7fb3340d5c90 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb358122b50 0x7fb358122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb358115440 0x7fb35811d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 --2- 10.20.193.70:0/2187924392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb35810f230 0x7fb35811d250 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 -- 10.20.193.70:0/2187924392 >> 10.20.193.70:0/2187924392 conn(0x7fb3580ecb30 msgr2=0x7fb35810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 -- 10.20.193.70:0/2187924392 shutdown_connections 2026-02-13T03:45:34.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.667+0000 7fb33d7fa6c0 1 -- 10.20.193.70:0/2187924392 wait complete. 2026-02-13T03:45:34.672 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378644 got 81604378643 for osd.3 2026-02-13T03:45:34.676 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.674+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f28640f3ad0 con 0x7f28640f2fb0 2026-02-13T03:45:34.677 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.675+0000 7f2843fff6c0 1 -- 10.20.193.70:0/2600580241 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f28540aa3c0 con 0x7f28640f2fb0 2026-02-13T03:45:34.677 INFO:teuthology.orchestra.run.trial070.stdout:30064771095 2026-02-13T03:45:34.679 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28380b5710 msgr2=0x7f28380d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.679 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28380b5710 0x7f28380d5bc0 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2858009260 tx=0x7f2858009440 comp rx=0 tx=0).stop 2026-02-13T03:45:34.679 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28640f2fb0 msgr2=0x7f28640f8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28640f2fb0 0x7f28640f8280 secure :-1 s=READY pgs=291 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f285400c6c0 tx=0x7f285400cb90 comp rx=0 tx=0).stop 2026-02-13T03:45:34.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 shutdown_connections 2026-02-13T03:45:34.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28380b5710 0x7f28380d5bc0 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28640f2fb0 0x7f28640f8280 unknown :-1 s=CLOSED pgs=291 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28641131c0 0x7f2864173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 --2- 10.20.193.70:0/2600580241 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f286410cfb0 0x7f28640f2980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 >> 10.20.193.70:0/2600580241 conn(0x7f28640ea8b0 msgr2=0x7f286410b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 shutdown_connections 2026-02-13T03:45:34.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.677+0000 7f286979c6c0 1 -- 10.20.193.70:0/2600580241 wait complete. 2026-02-13T03:45:34.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.679+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc93c10fc20 con 0x7fc93c115440 2026-02-13T03:45:34.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.680+0000 7fc91bfff6c0 1 -- 10.20.193.70:0/2048791524 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc9240a9760 con 0x7fc93c115440 2026-02-13T03:45:34.682 INFO:teuthology.orchestra.run.trial070.stdout:171798691852 2026-02-13T03:45:34.682 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.680+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6cc0122870 con 0x7f6cc0126ff0 2026-02-13T03:45:34.682 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.680+0000 7f6cb5ffb6c0 1 -- 10.20.193.70:0/3767599514 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6cbc0ce8b0 con 0x7f6cc0126ff0 2026-02-13T03:45:34.683 INFO:teuthology.orchestra.run.trial070.stdout:279172874248 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.682+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc9100b5680 msgr2=0x7fc9100d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.682+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc9100b5680 0x7fc9100d5b30 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc930004750 tx=0x7fc930006d50 comp rx=0 tx=0).stop 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.682+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 msgr2=0x7fc93c175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.682+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 0x7fc93c175ce0 secure :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc92400b800 tx=0x7fc92400bcd0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 shutdown_connections 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc9100b5680 0x7fc9100d5b30 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc93c0fe850 0x7fc93c0fecf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc93c115440 0x7fc93c175ce0 unknown :-1 s=CLOSED pgs=64 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7fc9415606c0 1 --2- 10.20.193.70:0/2048791524 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc93c10f230 0x7fc93c0fe310 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 >> 10.20.193.70:0/2048791524 conn(0x7fc93c0ecb30 msgr2=0x7fc93c110c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.686 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 shutdown_connections 2026-02-13T03:45:34.686 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f764010fc20 con 0x7f764010f230 2026-02-13T03:45:34.686 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7fc9415606c0 1 -- 10.20.193.70:0/2048791524 wait complete. 2026-02-13T03:45:34.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6c9c0b5860 msgr2=0x7f6c9c0d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6c9c0b5860 0x7f6c9c0d5d10 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cb0004750 tx=0x7f6cb0009260 comp rx=0 tx=0).stop 2026-02-13T03:45:34.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6cc0126ff0 msgr2=0x7f6cc0127490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6cc0126ff0 0x7f6cc0127490 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cbc00aa40 tx=0x7f6cbc0054b0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 shutdown_connections 2026-02-13T03:45:34.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6c9c0b5860 0x7f6c9c0d5d10 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6cc0126ff0 0x7f6cc0127490 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6cc01198f0 0x7f6cc0121c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.688 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 --2- 10.20.193.70:0/3767599514 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cc01137a0 0x7f6cc01216f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.688 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 >> 10.20.193.70:0/3767599514 conn(0x7f6cc0060760 msgr2=0x7f6cc0116f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.688 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 shutdown_connections 2026-02-13T03:45:34.688 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f6cc701c6c0 1 -- 10.20.193.70:0/3767599514 wait complete. 2026-02-13T03:45:34.688 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.683+0000 7f762e7fc6c0 1 -- 10.20.193.70:0/1700034426 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f76300ca6f0 con 0x7f764010f230 2026-02-13T03:45:34.689 INFO:teuthology.orchestra.run.trial070.stdout:249108103177 2026-02-13T03:45:34.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f761c0b57e0 msgr2=0x7f761c0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f761c0b57e0 0x7f761c0d5c90 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7640123b60 tx=0x7f7634006f90 comp rx=0 tx=0).stop 2026-02-13T03:45:34.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f764010f230 msgr2=0x7f764011d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:34.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f764010f230 0x7f764011d1d0 secure :-1 s=READY pgs=65 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7630009970 tx=0x7f763002fa50 comp rx=0 tx=0).stop 2026-02-13T03:45:34.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 shutdown_connections 2026-02-13T03:45:34.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f761c0b57e0 0x7f761c0d5c90 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7640122ad0 0x7f7640122f70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7640115440 0x7f764011d710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 --2- 10.20.193.70:0/1700034426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f764010f230 0x7f764011d1d0 unknown :-1 s=CLOSED pgs=65 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:34.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 >> 10.20.193.70:0/1700034426 conn(0x7f76400ecb30 msgr2=0x7f764010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:34.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 shutdown_connections 2026-02-13T03:45:34.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:34.686+0000 7f76477376c0 1 -- 10.20.193.70:0/1700034426 wait complete. 2026-02-13T03:45:34.701 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928233995 got 231928233994 for osd.9 2026-02-13T03:45:34.709 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822672 got 154618822670 for osd.6 2026-02-13T03:45:34.723 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672982 got 42949672981 for osd.1 2026-02-13T03:45:34.731 INFO:tasks.cephadm.ceph_manager.ceph:need seq 30064771096 got 30064771095 for osd.0 2026-02-13T03:45:34.737 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103178 got 249108103177 for osd.10 2026-02-13T03:45:34.743 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874249 got 279172874248 for osd.11 2026-02-13T03:45:34.756 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691853 got 171798691852 for osd.7 2026-02-13T03:45:35.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: pgmap v191: 97 pgs: 97 active+clean; 630 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 8.8 KiB/s wr, 9 op/s 2026-02-13T03:45:35.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/476857168' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:45:35.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/919372343' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:45:35.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/254571819' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:45:35.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3649563113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:45:35.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/752622430' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:45:35.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1432892631' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:45:35.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3088467833' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:45:35.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2187924392' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:45:35.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2600580241' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:45:35.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2048791524' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:45:35.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3767599514' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:45:35.049 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1700034426' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:45:35.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: pgmap v191: 97 pgs: 97 active+clean; 630 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 8.8 KiB/s wr, 9 op/s 2026-02-13T03:45:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/476857168' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:45:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/919372343' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:45:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/254571819' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:45:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3649563113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:45:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/752622430' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:45:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1432892631' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:45:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3088467833' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:45:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2187924392' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:45:35.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2600580241' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:45:35.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2048791524' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:45:35.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3767599514' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:45:35.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1700034426' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:45:35.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: pgmap v191: 97 pgs: 97 active+clean; 630 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 8.8 KiB/s wr, 9 op/s 2026-02-13T03:45:35.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/476857168' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:45:35.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/919372343' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/254571819' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3649563113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/752622430' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1432892631' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3088467833' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2187924392' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2600580241' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2048791524' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3767599514' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:45:35.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1700034426' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:45:35.628 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T03:45:35.643 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T03:45:35.647 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T03:45:35.666 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T03:45:35.673 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T03:45:35.702 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T03:45:35.711 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T03:45:35.724 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T03:45:35.732 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T03:45:35.738 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T03:45:35.743 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T03:45:35.749 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.757 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T03:45:35.797 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.797 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.804 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.846 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.853 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.853 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.887 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.889 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.897 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.897 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.920 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.916+0000 7f944df336c0 1 -- 10.20.193.70:0/1228595855 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f944810f230 msgr2=0x7f944810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.920 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.916+0000 7f944df336c0 1 --2- 10.20.193.70:0/1228595855 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f944810f230 0x7f944810f600 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=5527512510555661075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94340099a0 tx=0x7f943402ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.916+0000 7f944df336c0 1 -- 10.20.193.70:0/1228595855 shutdown_connections 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.916+0000 7f944df336c0 1 --2- 10.20.193.70:0/1228595855 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9448115440 0x7f9448175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.916+0000 7f944df336c0 1 --2- 10.20.193.70:0/1228595855 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f944810fc20 0x7f9448114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.916+0000 7f944df336c0 1 --2- 10.20.193.70:0/1228595855 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f944810f230 0x7f944810f600 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=5527512510555661075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.916+0000 7f944df336c0 1 -- 10.20.193.70:0/1228595855 >> 10.20.193.70:0/1228595855 conn(0x7f94480ecb30 msgr2=0x7f944810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.916+0000 7f944df336c0 1 -- 10.20.193.70:0/1228595855 shutdown_connections 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.916+0000 7f944df336c0 1 -- 10.20.193.70:0/1228595855 wait complete. 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f944df336c0 1 Processor -- start 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f944df336c0 1 -- start start 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f944df336c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f944810f230 0x7f94480f91f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.921 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f944df336c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9448115440 0x7f9448175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f944df336c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94480f9820 0x7f94480feaa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f944df336c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94480f9f10 con 0x7f9448115440 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9446ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9448115440 0x7f9448175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9446ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9448115440 0x7f9448175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34204/0 (socket says 10.20.193.70:34204) 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9446ffd6c0 1 -- 10.20.193.70:0/2381885794 learned_addr learned my addr 10.20.193.70:0/2381885794 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f94477fe6c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f944810f230 0x7f94480f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f94480fefe0 con 0x7f944810f230 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94480ff1a0 con 0x7f94480f9820 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9447fff6c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94480f9820 0x7f94480feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9446ffd6c0 1 -- 10.20.193.70:0/2381885794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94480f9820 msgr2=0x7f94480feaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.922 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9446ffd6c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94480f9820 0x7f94480feaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9446ffd6c0 1 -- 10.20.193.70:0/2381885794 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f944810f230 msgr2=0x7f94480f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9446ffd6c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f944810f230 0x7f94480f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9446ffd6c0 1 -- 10.20.193.70:0/2381885794 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9434009590 con 0x7f9448115440 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.917+0000 7f9446ffd6c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9448115440 0x7f9448175ce0 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9438005fd0 tx=0x7f943800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.918+0000 7f9444ff96c0 1 -- 10.20.193.70:0/2381885794 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9438004280 con 0x7f9448115440 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.918+0000 7f9444ff96c0 1 -- 10.20.193.70:0/2381885794 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f94380043e0 con 0x7f9448115440 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.918+0000 7f9444ff96c0 1 -- 10.20.193.70:0/2381885794 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f943800ccd0 con 0x7f9448115440 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.918+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94480ff480 con 0x7f9448115440 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.918+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94480ff910 con 0x7f9448115440 2026-02-13T03:45:35.923 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.918+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9448110500 con 0x7f9448115440 2026-02-13T03:45:35.924 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.920+0000 7f9444ff96c0 1 -- 10.20.193.70:0/2381885794 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f94380026b0 con 0x7f9448115440 2026-02-13T03:45:35.924 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.920+0000 7f9444ff96c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f941c0b5710 0x7f941c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.924 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.921+0000 7f94477fe6c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f941c0b5710 0x7f941c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.925 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.921+0000 7f9444ff96c0 1 -- 10.20.193.70:0/2381885794 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f94380aa610 con 0x7f9448115440 2026-02-13T03:45:35.925 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.921+0000 7f94477fe6c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f941c0b5710 0x7f941c0d5bc0 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434005b40 tx=0x7f94340023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:35.925 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.921+0000 7f9444ff96c0 1 -- 10.20.193.70:0/2381885794 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f94380a6260 con 0x7f9448115440 2026-02-13T03:45:35.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.929+0000 7f138c0b46c0 1 -- 10.20.193.70:0/1462420703 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f138410f230 msgr2=0x7f138410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.932 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.929+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/1462420703 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f138410f230 0x7f138410f600 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=4495660410823066607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13740099a0 tx=0x7f137402ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:35.932 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.929+0000 7f138c0b46c0 1 -- 10.20.193.70:0/1462420703 shutdown_connections 2026-02-13T03:45:35.932 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.929+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/1462420703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1384115440 0x7f1384175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.932 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.929+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/1462420703 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f138410fc20 0x7f1384114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.932 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.929+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/1462420703 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f138410f230 0x7f138410f600 unknown :-1 s=CLOSED pgs=294 gs=1 cs=0 l=1 c_cookie=4495660410823066607 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.932 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 -- 10.20.193.70:0/1462420703 >> 10.20.193.70:0/1462420703 conn(0x7f13840ecb30 msgr2=0x7f138410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:35.932 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 -- 10.20.193.70:0/1462420703 shutdown_connections 2026-02-13T03:45:35.932 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 -- 10.20.193.70:0/1462420703 wait complete. 2026-02-13T03:45:35.934 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 Processor -- start 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 -- start start 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f138410f230 0x7f138411d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1384115440 0x7f138411d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1384122c20 0x7f13841230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1384123630 con 0x7f138410f230 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f13841237a0 con 0x7f1384115440 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138c0b46c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1384123960 con 0x7f1384122c20 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138a6266c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1384122c20 0x7f13841230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f138a6266c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1384122c20 0x7f13841230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:57196/0 (socket says 10.20.193.70:57196) 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f138a6266c0 1 -- 10.20.193.70:0/2069726172 learned_addr learned my addr 10.20.193.70:0/2069726172 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:35.935 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.930+0000 7f1389e256c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f138410f230 0x7f138411d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f13896246c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1384115440 0x7f138411d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f1389e256c0 1 -- 10.20.193.70:0/2069726172 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1384122c20 msgr2=0x7f13841230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f1389e256c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1384122c20 0x7f13841230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f1389e256c0 1 -- 10.20.193.70:0/2069726172 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1384115440 msgr2=0x7f138411d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f1389e256c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1384115440 0x7f138411d860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f1389e256c0 1 -- 10.20.193.70:0/2069726172 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1374009590 con 0x7f138410f230 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f13896246c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1384115440 0x7f138411d860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f1389e256c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f138410f230 0x7f138411d320 secure :-1 s=READY pgs=295 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13740099a0 tx=0x7f137402fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f1372ffd6c0 1 -- 10.20.193.70:0/2069726172 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1374002ae0 con 0x7f138410f230 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1384163db0 con 0x7f138410f230 2026-02-13T03:45:35.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1384164230 con 0x7f138410f230 2026-02-13T03:45:35.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.931+0000 7f1372ffd6c0 1 -- 10.20.193.70:0/2069726172 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1374007680 con 0x7f138410f230 2026-02-13T03:45:35.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.932+0000 7f1372ffd6c0 1 -- 10.20.193.70:0/2069726172 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1374036480 con 0x7f138410f230 2026-02-13T03:45:35.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.932+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1384110500 con 0x7f138410f230 2026-02-13T03:45:35.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.934+0000 7f1372ffd6c0 1 -- 10.20.193.70:0/2069726172 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f1374002c40 con 0x7f138410f230 2026-02-13T03:45:35.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.935+0000 7f1372ffd6c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f13600b5610 0x7f13600d5ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.935+0000 7f13896246c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f13600b5610 0x7f13600d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7f1372ffd6c0 1 -- 10.20.193.70:0/2069726172 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f1374107ba0 con 0x7f138410f230 2026-02-13T03:45:35.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 -- 10.20.193.70:0/2181484438 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe0810fc20 msgr2=0x7fbe08114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 --2- 10.20.193.70:0/2181484438 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe0810fc20 0x7fbe08114c60 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=8215714600652487507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf00099a0 tx=0x7fbdf002ed50 comp rx=0 tx=0).stop 2026-02-13T03:45:35.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 -- 10.20.193.70:0/2181484438 shutdown_connections 2026-02-13T03:45:35.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 --2- 10.20.193.70:0/2181484438 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe08115440 0x7fbe08175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 --2- 10.20.193.70:0/2181484438 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe0810fc20 0x7fbe08114c60 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=8215714600652487507 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 --2- 10.20.193.70:0/2181484438 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f230 0x7fbe0810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7f1372ffd6c0 1 -- 10.20.193.70:0/2069726172 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1374140680 con 0x7f138410f230 2026-02-13T03:45:35.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7f13896246c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f13600b5610 0x7f13600d5ac0 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1384123cb0 tx=0x7f1378009630 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 -- 10.20.193.70:0/2181484438 >> 10.20.193.70:0/2181484438 conn(0x7fbe080ecb30 msgr2=0x7fbe0810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 -- 10.20.193.70:0/2181484438 shutdown_connections 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 -- 10.20.193.70:0/2181484438 wait complete. 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.936+0000 7fbe0cf886c0 1 Processor -- start 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe0cf886c0 1 -- start start 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe0cf886c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f230 0x7fbe080f4b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe0cf886c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe08115440 0x7fbe08175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe0cf886c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe080f5170 0x7fbe080fa440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe0cf886c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe080f5860 con 0x7fbe080f5170 2026-02-13T03:45:35.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe06d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe080f5170 0x7fbe080fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe0cf886c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fbe080fa980 con 0x7fbe0810f230 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe0cf886c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe080fab40 con 0x7fbe08115440 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe06d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe080f5170 0x7fbe080fa440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34258/0 (socket says 10.20.193.70:34258) 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe06d766c0 1 -- 10.20.193.70:0/2849243600 learned_addr learned my addr 10.20.193.70:0/2849243600 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe065756c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f230 0x7fbe080f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe05d746c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe08115440 0x7fbe08175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe06d766c0 1 -- 10.20.193.70:0/2849243600 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe08115440 msgr2=0x7fbe08175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe06d766c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe08115440 0x7fbe08175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe06d766c0 1 -- 10.20.193.70:0/2849243600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f230 msgr2=0x7fbe080f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe06d766c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f230 0x7fbe080f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe06d766c0 1 -- 10.20.193.70:0/2849243600 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf0009590 con 0x7fbe080f5170 2026-02-13T03:45:35.944 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.937+0000 7fbe06d766c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe080f5170 0x7fbe080fa440 secure :-1 s=READY pgs=297 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf8006ea0 tx=0x7fbdf800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:35.944 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.938+0000 7fbdef7fe6c0 1 -- 10.20.193.70:0/2849243600 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf8003a30 con 0x7fbe080f5170 2026-02-13T03:45:35.944 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.938+0000 7fbe0cf886c0 1 -- 10.20.193.70:0/2849243600 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe080fae20 con 0x7fbe080f5170 2026-02-13T03:45:35.944 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.938+0000 7fbdef7fe6c0 1 -- 10.20.193.70:0/2849243600 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbdf80054f0 con 0x7fbe080f5170 2026-02-13T03:45:35.944 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.938+0000 7fbdef7fe6c0 1 -- 10.20.193.70:0/2849243600 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdf800dcd0 con 0x7fbe080f5170 2026-02-13T03:45:35.944 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.938+0000 7fbe0cf886c0 1 -- 10.20.193.70:0/2849243600 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe080fb5b0 con 0x7fbe080f5170 2026-02-13T03:45:35.944 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.939+0000 7fbded7fa6c0 1 -- 10.20.193.70:0/2849243600 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe08110500 con 0x7fbe080f5170 2026-02-13T03:45:35.944 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.940+0000 7fbdef7fe6c0 1 -- 10.20.193.70:0/2849243600 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fbdf8003b90 con 0x7fbe080f5170 2026-02-13T03:45:35.945 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.941+0000 7fbdef7fe6c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbde00b5690 0x7fbde00d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.945 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.941+0000 7fbe065756c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbde00b5690 0x7fbde00d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.945 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.941+0000 7fbdef7fe6c0 1 -- 10.20.193.70:0/2849243600 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fbdf80e49c0 con 0x7fbe080f5170 2026-02-13T03:45:35.946 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.941+0000 7fbdef7fe6c0 1 -- 10.20.193.70:0/2849243600 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbdf80a73e0 con 0x7fbe080f5170 2026-02-13T03:45:35.946 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.941+0000 7fbe065756c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbde00b5690 0x7fbde00d5b40 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdfc004750 tx=0x7fbdfc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:35.947 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.942+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1351075591 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010bb00 msgr2=0x7f5eb0152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.947 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.942+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1351075591 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010bb00 0x7f5eb0152ee0 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=266736042639929920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea4009970 tx=0x7f5ea402ed50 comp rx=0 tx=0).stop 2026-02-13T03:45:35.947 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.942+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1351075591 shutdown_connections 2026-02-13T03:45:35.947 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.942+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1351075591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5eb0153420 0x7f5eb0173800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.947 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.942+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1351075591 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010bb00 0x7f5eb0152ee0 unknown :-1 s=CLOSED pgs=298 gs=1 cs=0 l=1 c_cookie=266736042639929920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.947 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.942+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1351075591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5eb010b1f0 0x7f5eb010b5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.947 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.942+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1351075591 >> 10.20.193.70:0/1351075591 conn(0x7f5eb0063af0 msgr2=0x7f5eb00642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.942+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1351075591 shutdown_connections 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.942+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1351075591 wait complete. 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb77076c0 1 Processor -- start 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb77076c0 1 -- start start 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb77076c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010b1f0 0x7f5eb015f2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb77076c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5eb010bb00 0x7f5eb015f800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb77076c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5eb0153420 0x7f5eb0164bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb77076c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0165180 con 0x7f5eb010b1f0 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb77076c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb01652f0 con 0x7f5eb0153420 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb77076c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb01654b0 con 0x7f5eb010bb00 2026-02-13T03:45:35.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb54786c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010b1f0 0x7f5eb015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb54786c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010b1f0 0x7f5eb015f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34276/0 (socket says 10.20.193.70:34276) 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb54786c0 1 -- 10.20.193.70:0/1484655775 learned_addr learned my addr 10.20.193.70:0/1484655775 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb5c796c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5eb0153420 0x7f5eb0164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb5c796c0 1 -- 10.20.193.70:0/1484655775 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5eb010bb00 msgr2=0x7f5eb015f800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb5c796c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5eb010bb00 0x7f5eb015f800 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb5c796c0 1 -- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010b1f0 msgr2=0x7f5eb015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb5c796c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010b1f0 0x7f5eb015f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb5c796c0 1 -- 10.20.193.70:0/1484655775 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea4009590 con 0x7f5eb0153420 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.943+0000 7f5eb54786c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010b1f0 0x7f5eb015f2c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.944+0000 7f5eb5c796c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5eb0153420 0x7f5eb0164bc0 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eb010c1d0 tx=0x7f5eac00cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.944+0000 7f5e9e7fc6c0 1 -- 10.20.193.70:0/1484655775 <== mon.2 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5eac0054a0 con 0x7f5eb0153420 2026-02-13T03:45:35.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.944+0000 7f5e9e7fc6c0 1 -- 10.20.193.70:0/1484655775 <== mon.2 v2:10.20.193.127:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5eac00a030 con 0x7f5eb0153420 2026-02-13T03:45:35.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.944+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb0165790 con 0x7f5eb0153420 2026-02-13T03:45:35.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.944+0000 7f5e9e7fc6c0 1 -- 10.20.193.70:0/1484655775 <== mon.2 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5eac00db70 con 0x7f5eb0153420 2026-02-13T03:45:35.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.944+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb014f050 con 0x7f5eb0153420 2026-02-13T03:45:35.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.944+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb0065120 con 0x7f5eb0153420 2026-02-13T03:45:35.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.945+0000 7f5e9e7fc6c0 1 -- 10.20.193.70:0/1484655775 <== mon.2 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f5eac005600 con 0x7f5eb0153420 2026-02-13T03:45:35.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.946+0000 7f5e9e7fc6c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e8c0b5710 0x7f5e8c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.946+0000 7f5e9e7fc6c0 1 -- 10.20.193.70:0/1484655775 <== mon.2 v2:10.20.193.127:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f5eac0e4980 con 0x7f5eb0153420 2026-02-13T03:45:35.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.946+0000 7f5eb54786c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e8c0b5710 0x7f5e8c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.946+0000 7f5e9e7fc6c0 1 -- 10.20.193.70:0/1484655775 <== mon.2 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5eac0a73a0 con 0x7f5eb0153420 2026-02-13T03:45:35.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.947+0000 7f5eb54786c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e8c0b5710 0x7f5e8c0d5bc0 secure :-1 s=READY pgs=215 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea0005980 tx=0x7f5ea0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:35.957 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:35.992 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/3711970190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410d9a0 msgr2=0x7f1e341129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/3711970190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410d9a0 0x7f1e341129e0 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=685038544060990185 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e28009970 tx=0x7f1e2802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:35.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/3711970190 shutdown_connections 2026-02-13T03:45:35.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/3711970190 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e341131c0 0x7f1e34173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/3711970190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410d9a0 0x7f1e341129e0 unknown :-1 s=CLOSED pgs=58 gs=3 cs=0 l=1 c_cookie=685038544060990185 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/3711970190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e3410cfb0 0x7f1e3410d380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/3711970190 >> 10.20.193.70:0/3711970190 conn(0x7f1e340ea8b0 msgr2=0x7f1e3410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:35.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/3711970190 shutdown_connections 2026-02-13T03:45:35.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/3711970190 wait complete. 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 Processor -- start 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.988+0000 7f1e3c7486c0 1 -- start start 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3c7486c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410cfb0 0x7f1e340f2a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3c7486c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e341131c0 0x7f1e34173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3c7486c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e340f3050 0x7f1e340f8320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e39cb86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e341131c0 0x7f1e34173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3a4b96c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410cfb0 0x7f1e340f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3a4b96c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410cfb0 0x7f1e340f2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:57296/0 (socket says 10.20.193.70:57296) 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e39cb86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e341131c0 0x7f1e34173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34284/0 (socket says 10.20.193.70:34284) 2026-02-13T03:45:35.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3a4b96c0 1 -- 10.20.193.70:0/4041774816 learned_addr learned my addr 10.20.193.70:0/4041774816 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1e340f3740 con 0x7f1e341131c0 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1e340f8860 con 0x7f1e3410cfb0 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1e340f8a20 con 0x7f1e340f3050 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e3acba6c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e340f3050 0x7f1e340f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e39cb86c0 1 -- 10.20.193.70:0/4041774816 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e340f3050 msgr2=0x7f1e340f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.989+0000 7f1e39cb86c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e340f3050 0x7f1e340f8320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e39cb86c0 1 -- 10.20.193.70:0/4041774816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410cfb0 msgr2=0x7f1e340f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e39cb86c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410cfb0 0x7f1e340f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e39cb86c0 1 -- 10.20.193.70:0/4041774816 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e28009590 con 0x7f1e341131c0 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e3a4b96c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410cfb0 0x7f1e340f2a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e39cb86c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e341131c0 0x7f1e34173a60 secure :-1 s=READY pgs=299 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e28009970 tx=0x7f1e28031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:35.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e1b7fe6c0 1 -- 10.20.193.70:0/4041774816 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e2802fdd0 con 0x7f1e341131c0 2026-02-13T03:45:35.996 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e1b7fe6c0 1 -- 10.20.193.70:0/4041774816 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1e280046d0 con 0x7f1e341131c0 2026-02-13T03:45:35.996 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e1b7fe6c0 1 -- 10.20.193.70:0/4041774816 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e28031940 con 0x7f1e341131c0 2026-02-13T03:45:35.996 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e340f8ca0 con 0x7f1e341131c0 2026-02-13T03:45:35.996 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.990+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e340f9170 con 0x7f1e341131c0 2026-02-13T03:45:35.996 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3410e280 con 0x7f1e341131c0 2026-02-13T03:45:35.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f18e85d16c0 1 -- 10.20.193.70:0/239221884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f18e0159b20 msgr2=0x7f18e0179f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:35.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/239221884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f18e0159b20 0x7f18e0179f00 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=15436210573062220525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18dc00aa40 tx=0x7f18dc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f18e85d16c0 1 -- 10.20.193.70:0/239221884 shutdown_connections 2026-02-13T03:45:35.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/239221884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f18e0159b20 0x7f18e0179f00 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=15436210573062220525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/239221884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18e00675f0 0x7f18e01595e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/239221884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18e0066ce0 0x7f18e00670b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f18e85d16c0 1 -- 10.20.193.70:0/239221884 >> 10.20.193.70:0/239221884 conn(0x7f18e0064810 msgr2=0x7f18e0064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f18e85d16c0 1 -- 10.20.193.70:0/239221884 shutdown_connections 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.991+0000 7f18e85d16c0 1 -- 10.20.193.70:0/239221884 wait complete. 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.992+0000 7f18e85d16c0 1 Processor -- start 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.992+0000 7f18e85d16c0 1 -- start start 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.992+0000 7f18e85d16c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18e0066ce0 0x7f18e01658e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.992+0000 7f18e85d16c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18e00675f0 0x7f18e0165e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e85d16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f18e0159b20 0x7f18e016b1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e85d16c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18e016b7a0 con 0x7f18e0159b20 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e85d16c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f18e016b910 con 0x7f18e00675f0 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e85d16c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f18e016bad0 con 0x7f18e0066ce0 2026-02-13T03:45:35.999 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e6b436c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f18e0159b20 0x7f18e016b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.000 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e5b416c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18e00675f0 0x7f18e0165e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.000 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e63426c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18e0066ce0 0x7f18e01658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.000 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e6b436c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f18e0159b20 0x7f18e016b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34304/0 (socket says 10.20.193.70:34304) 2026-02-13T03:45:36.000 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e6b436c0 1 -- 10.20.193.70:0/2485601427 learned_addr learned my addr 10.20.193.70:0/2485601427 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:36.000 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f1e1b7fe6c0 1 -- 10.20.193.70:0/4041774816 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f1e280026b0 con 0x7f1e341131c0 2026-02-13T03:45:36.001 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e5b416c0 1 -- 10.20.193.70:0/2485601427 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18e0066ce0 msgr2=0x7f18e01658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.001 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e5b416c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18e0066ce0 0x7f18e01658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.001 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e5b416c0 1 -- 10.20.193.70:0/2485601427 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f18e0159b20 msgr2=0x7f18e016b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.001 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e5b416c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f18e0159b20 0x7f18e016b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.001 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e5b416c0 1 -- 10.20.193.70:0/2485601427 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18dc00a660 con 0x7f18e00675f0 2026-02-13T03:45:36.001 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18e5b416c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18e00675f0 0x7f18e0165e20 secure :-1 s=READY pgs=59 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18d400b6c0 tx=0x7f18d400bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.002 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f1e1b7fe6c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1e100b5790 0x7f1e100d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.002 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18c77fe6c0 1 -- 10.20.193.70:0/2485601427 <== mon.2 v2:10.20.193.127:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18d4004520 con 0x7f18e00675f0 2026-02-13T03:45:36.002 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18c77fe6c0 1 -- 10.20.193.70:0/2485601427 <== mon.2 v2:10.20.193.127:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f18d4009030 con 0x7f18e00675f0 2026-02-13T03:45:36.002 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.993+0000 7f18c77fe6c0 1 -- 10.20.193.70:0/2485601427 <== mon.2 v2:10.20.193.127:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18d400cc10 con 0x7f18e00675f0 2026-02-13T03:45:36.003 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.994+0000 7f1e1b7fe6c0 1 -- 10.20.193.70:0/4041774816 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f1e28107920 con 0x7f1e341131c0 2026-02-13T03:45:36.003 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.994+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e016bdb0 con 0x7f18e00675f0 2026-02-13T03:45:36.003 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.994+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e0155750 con 0x7f18e00675f0 2026-02-13T03:45:36.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.994+0000 7f1e3a4b96c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1e100b5790 0x7f1e100d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.994+0000 7f1e3a4b96c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1e100b5790 0x7f1e100d5c40 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e240095c0 tx=0x7f1e24009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.994+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e00681f0 con 0x7f18e00675f0 2026-02-13T03:45:36.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.994+0000 7f1e1b7fe6c0 1 -- 10.20.193.70:0/4041774816 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1e280ca340 con 0x7f1e341131c0 2026-02-13T03:45:36.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.995+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/295727631 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d94159af0 msgr2=0x7f9d94179ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.995+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/295727631 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d94159af0 0x7f9d94179ed0 secure :-1 s=READY pgs=301 gs=2 cs=0 l=1 c_cookie=16416499346507220437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d8400aca0 tx=0x7f9d84030040 comp rx=0 tx=0).stop 2026-02-13T03:45:36.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.995+0000 7f18c77fe6c0 1 -- 10.20.193.70:0/2485601427 <== mon.2 v2:10.20.193.127:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f18d40026b0 con 0x7f18e00675f0 2026-02-13T03:45:36.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/295727631 shutdown_connections 2026-02-13T03:45:36.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/295727631 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d94159af0 0x7f9d94179ed0 unknown :-1 s=CLOSED pgs=301 gs=2 cs=0 l=1 c_cookie=16416499346507220437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/295727631 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d94060ce0 0x7f9d94061110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/295727631 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d940622d0 0x7f9d940607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/295727631 >> 10.20.193.70:0/295727631 conn(0x7f9d940ea8b0 msgr2=0x7f9d9410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/295727631 shutdown_connections 2026-02-13T03:45:36.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/295727631 wait complete. 2026-02-13T03:45:36.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f18c77fe6c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18bc0b57e0 0x7f18bc0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f18c77fe6c0 1 -- 10.20.193.70:0/2485601427 <== mon.2 v2:10.20.193.127:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f18d40e3880 con 0x7f18e00675f0 2026-02-13T03:45:36.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f18e63426c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18bc0b57e0 0x7f18bc0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f9d98fac6c0 1 Processor -- start 2026-02-13T03:45:36.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f9d98fac6c0 1 -- start start 2026-02-13T03:45:36.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.996+0000 7f18e63426c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18bc0b57e0 0x7f18bc0d5c90 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18d0004750 tx=0x7f18d0009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d98fac6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d94060ce0 0x7f9d940f22e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d98fac6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d940622d0 0x7f9d940f2820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d98fac6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d94159af0 0x7f9d940f7be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d98fac6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d940f8230 con 0x7f9d940622d0 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d98fac6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9d940f83a0 con 0x7f9d94060ce0 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d98fac6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9d940f8560 con 0x7f9d94159af0 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d91d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d940622d0 0x7f9d940f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d91d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d940622d0 0x7f9d940f2820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34320/0 (socket says 10.20.193.70:34320) 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d91d746c0 1 -- 10.20.193.70:0/221794258 learned_addr learned my addr 10.20.193.70:0/221794258 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d925756c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d94060ce0 0x7f9d940f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d92d766c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d94159af0 0x7f9d940f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d91d746c0 1 -- 10.20.193.70:0/221794258 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d94159af0 msgr2=0x7f9d940f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d91d746c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d94159af0 0x7f9d940f7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d91d746c0 1 -- 10.20.193.70:0/221794258 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d94060ce0 msgr2=0x7f9d940f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d91d746c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d94060ce0 0x7f9d940f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d91d746c0 1 -- 10.20.193.70:0/221794258 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8400a660 con 0x7f9d940622d0 2026-02-13T03:45:36.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d925756c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d94060ce0 0x7f9d940f22e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:36.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d91d746c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d940622d0 0x7f9d940f2820 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d7c009490 tx=0x7f9d7c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d7b7fe6c0 1 -- 10.20.193.70:0/221794258 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d7c004a80 con 0x7f9d940622d0 2026-02-13T03:45:36.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d940f8840 con 0x7f9d940622d0 2026-02-13T03:45:36.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d940f8f00 con 0x7f9d940622d0 2026-02-13T03:45:36.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d7b7fe6c0 1 -- 10.20.193.70:0/221794258 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9d7c009030 con 0x7f9d940622d0 2026-02-13T03:45:36.012 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f9d7b7fe6c0 1 -- 10.20.193.70:0/221794258 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d7c00cdd0 con 0x7f9d940622d0 2026-02-13T03:45:36.013 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.997+0000 7f18c77fe6c0 1 -- 10.20.193.70:0/2485601427 <== mon.2 v2:10.20.193.127:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f18d40a62a0 con 0x7f18e00675f0 2026-02-13T03:45:36.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.998+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d94061cb0 con 0x7f9d940622d0 2026-02-13T03:45:36.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:35.999+0000 7f9d7b7fe6c0 1 -- 10.20.193.70:0/221794258 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f9d7c005000 con 0x7f9d940622d0 2026-02-13T03:45:36.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.000+0000 7f9d7b7fe6c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9d6c0b5690 0x7f9d6c0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.000+0000 7f9d7b7fe6c0 1 -- 10.20.193.70:0/221794258 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f9d7c0e3bb0 con 0x7f9d940622d0 2026-02-13T03:45:36.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.000+0000 7f9d925756c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9d6c0b5690 0x7f9d6c0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.000+0000 7f9d925756c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9d6c0b5690 0x7f9d6c0d5b40 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d88005fd0 tx=0x7f9d88009650 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.001+0000 7f9d7b7fe6c0 1 -- 10.20.193.70:0/221794258 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9d7c0a6610 con 0x7f9d940622d0 2026-02-13T03:45:36.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 -- 10.20.193.70:0/2624152272 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10fc20 msgr2=0x7f699c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/2624152272 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10fc20 0x7f699c114c60 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=666387751735594925 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69900099a0 tx=0x7f699002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:36.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 -- 10.20.193.70:0/2624152272 shutdown_connections 2026-02-13T03:45:36.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/2624152272 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f699c115440 0x7f699c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/2624152272 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10fc20 0x7f699c114c60 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=666387751735594925 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/2624152272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c10f230 0x7f699c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 -- 10.20.193.70:0/2624152272 >> 10.20.193.70:0/2624152272 conn(0x7f699c0ecb30 msgr2=0x7f699c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.035 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 -- 10.20.193.70:0/2624152272 shutdown_connections 2026-02-13T03:45:36.035 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 -- 10.20.193.70:0/2624152272 wait complete. 2026-02-13T03:45:36.036 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.032+0000 7f69a371c6c0 1 Processor -- start 2026-02-13T03:45:36.036 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a371c6c0 1 -- start start 2026-02-13T03:45:36.036 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a371c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10f230 0x7f699c0f4d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.036 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a371c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f699c115440 0x7f699c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.036 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a371c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c0f5390 0x7f699c0fa660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.036 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a371c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f699c0f5a80 con 0x7f699c10f230 2026-02-13T03:45:36.036 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a371c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f699c0faba0 con 0x7f699c115440 2026-02-13T03:45:36.036 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a371c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f699c0fad60 con 0x7f699c0f5390 2026-02-13T03:45:36.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a14916c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10f230 0x7f699c0f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a14916c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10f230 0x7f699c0f4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34336/0 (socket says 10.20.193.70:34336) 2026-02-13T03:45:36.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a14916c0 1 -- 10.20.193.70:0/1421054202 learned_addr learned my addr 10.20.193.70:0/1421054202 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:36.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a0c906c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f699c115440 0x7f699c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a1c926c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c0f5390 0x7f699c0fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a14916c0 1 -- 10.20.193.70:0/1421054202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c0f5390 msgr2=0x7f699c0fa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a14916c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c0f5390 0x7f699c0fa660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a14916c0 1 -- 10.20.193.70:0/1421054202 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f699c115440 msgr2=0x7f699c175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.037 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a14916c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f699c115440 0x7f699c175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f94480ff910 con 0x7f9448115440 2026-02-13T03:45:36.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a14916c0 1 -- 10.20.193.70:0/1421054202 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6990009590 con 0x7f699c10f230 2026-02-13T03:45:36.038 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a1c926c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c0f5390 0x7f699c0fa660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:36.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f69a14916c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10f230 0x7f699c0f4d60 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f698c009490 tx=0x7f698c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f698a7fc6c0 1 -- 10.20.193.70:0/1421054202 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f698c004a80 con 0x7f699c10f230 2026-02-13T03:45:36.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.034+0000 7f698a7fc6c0 1 -- 10.20.193.70:0/1421054202 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f698c009030 con 0x7f699c10f230 2026-02-13T03:45:36.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.034+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699c0fb040 con 0x7f699c10f230 2026-02-13T03:45:36.039 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.033+0000 7f9444ff96c0 1 -- 10.20.193.70:0/2381885794 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f943800ce60 con 0x7f9448115440 2026-02-13T03:45:36.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.034+0000 7f698a7fc6c0 1 -- 10.20.193.70:0/1421054202 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f698c00ce30 con 0x7f699c10f230 2026-02-13T03:45:36.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.034+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699c0fb7d0 con 0x7f699c10f230 2026-02-13T03:45:36.040 INFO:teuthology.orchestra.run.trial070.stdout:124554051601 2026-02-13T03:45:36.041 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f699c110500 con 0x7f699c10f230 2026-02-13T03:45:36.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1877351035 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d9f0 msgr2=0x7fcba01129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1877351035 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d9f0 0x7fcba01129e0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=17502267539663826653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb900099a0 tx=0x7fcb9002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:36.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1877351035 shutdown_connections 2026-02-13T03:45:36.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1877351035 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcba01131c0 0x7fcba0173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1877351035 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d9f0 0x7fcba01129e0 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=17502267539663826653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1877351035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcba010d000 0x7fcba010d3d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1877351035 >> 10.20.193.70:0/1877351035 conn(0x7fcba0065870 msgr2=0x7fcba010b060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1877351035 shutdown_connections 2026-02-13T03:45:36.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.035+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1877351035 wait complete. 2026-02-13T03:45:36.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba673c6c0 1 Processor -- start 2026-02-13T03:45:36.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba673c6c0 1 -- start start 2026-02-13T03:45:36.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba673c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d000 0x7fcba0117a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.043 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba673c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcba01131c0 0x7fcba0117f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.044 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7f698a7fc6c0 1 -- 10.20.193.70:0/1421054202 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f698c004060 con 0x7f699c10f230 2026-02-13T03:45:36.044 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba673c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcba011d300 0x7fcba011d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.044 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba673c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcba011dd10 con 0x7fcba010d000 2026-02-13T03:45:36.044 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba673c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fcba011de80 con 0x7fcba01131c0 2026-02-13T03:45:36.044 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba673c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcba011e040 con 0x7fcba011d300 2026-02-13T03:45:36.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcb9ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d000 0x7fcba0117a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcb9ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d000 0x7fcba0117a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34382/0 (socket says 10.20.193.70:34382) 2026-02-13T03:45:36.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcb9ffff6c0 1 -- 10.20.193.70:0/1523396988 learned_addr learned my addr 10.20.193.70:0/1523396988 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:36.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.037+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f941c0b5710 msgr2=0x7f941c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.037+0000 7f944df336c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f941c0b5710 0x7f941c0d5bc0 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434005b40 tx=0x7f94340023a0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.037+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9448115440 msgr2=0x7f9448175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.037+0000 7f944df336c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9448115440 0x7f9448175ce0 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9438005fd0 tx=0x7f943800bca0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.037+0000 7f698a7fc6c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f69780b5690 0x7f69780d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.037+0000 7f69a0c906c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f69780b5690 0x7f69780d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.037+0000 7f698a7fc6c0 1 -- 10.20.193.70:0/1421054202 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f698c0e3a00 con 0x7f699c10f230 2026-02-13T03:45:36.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcb9f7fe6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcba01131c0 0x7fcba0117f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba4cb26c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcba011d300 0x7fcba011d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcb9ffff6c0 1 -- 10.20.193.70:0/1523396988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcba011d300 msgr2=0x7fcba011d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcb9ffff6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcba011d300 0x7fcba011d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcb9ffff6c0 1 -- 10.20.193.70:0/1523396988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcba01131c0 msgr2=0x7fcba0117f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcb9ffff6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcba01131c0 0x7fcba0117f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcb9ffff6c0 1 -- 10.20.193.70:0/1523396988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb90009590 con 0x7fcba010d000 2026-02-13T03:45:36.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.036+0000 7fcba4cb26c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcba011d300 0x7fcba011d7a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:36.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.037+0000 7fcb9ffff6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d000 0x7fcba0117a00 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb8c00b710 tx=0x7fcb8c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f69a0c906c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f69780b5690 0x7f69780d5b40 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6990009260 tx=0x7f69900023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 shutdown_connections 2026-02-13T03:45:36.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f944df336c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f941c0b5710 0x7f941c0d5bc0 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f944df336c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94480f9820 0x7f94480feaa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f944df336c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9448115440 0x7f9448175ce0 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f944df336c0 1 --2- 10.20.193.70:0/2381885794 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f944810f230 0x7f94480f91f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 >> 10.20.193.70:0/2381885794 conn(0x7f94480ecb30 msgr2=0x7f9448111ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 shutdown_connections 2026-02-13T03:45:36.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f944df336c0 1 -- 10.20.193.70:0/2381885794 wait complete. 2026-02-13T03:45:36.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7fcb9d7fa6c0 1 -- 10.20.193.70:0/1523396988 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb8c004250 con 0x7fcba010d000 2026-02-13T03:45:36.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba015e4f0 con 0x7fcba010d000 2026-02-13T03:45:36.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7f698a7fc6c0 1 -- 10.20.193.70:0/1421054202 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f698c0a6420 con 0x7f699c10f230 2026-02-13T03:45:36.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba015e9d0 con 0x7fcba010d000 2026-02-13T03:45:36.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7fcb9d7fa6c0 1 -- 10.20.193.70:0/1523396988 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcb8c002d80 con 0x7fcba010d000 2026-02-13T03:45:36.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.038+0000 7fcb9d7fa6c0 1 -- 10.20.193.70:0/1523396988 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb8c00ce20 con 0x7fcba010d000 2026-02-13T03:45:36.051 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 -- 10.20.193.70:0/3284595296 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c153420 msgr2=0x7f585c173800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.051 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 --2- 10.20.193.70:0/3284595296 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c153420 0x7f585c173800 secure :-1 s=READY pgs=306 gs=2 cs=0 l=1 c_cookie=13483872278883203231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5850006fd0 tx=0x7f585002fd20 comp rx=0 tx=0).stop 2026-02-13T03:45:36.051 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 -- 10.20.193.70:0/3284595296 shutdown_connections 2026-02-13T03:45:36.051 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 --2- 10.20.193.70:0/3284595296 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c153420 0x7f585c173800 unknown :-1 s=CLOSED pgs=306 gs=2 cs=0 l=1 c_cookie=13483872278883203231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.051 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 --2- 10.20.193.70:0/3284595296 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f585c10bb00 0x7f585c152ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 --2- 10.20.193.70:0/3284595296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f585c10b1f0 0x7f585c10b5c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 -- 10.20.193.70:0/3284595296 >> 10.20.193.70:0/3284595296 conn(0x7f585c063af0 msgr2=0x7f585c0642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba0038a00 con 0x7fcba010d000 2026-02-13T03:45:36.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 -- 10.20.193.70:0/2586827123 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f29b010fbf0 msgr2=0x7f29b0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.052 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/2586827123 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f29b010fbf0 0x7f29b0114c30 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=6024229212892447772 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29a00099a0 tx=0x7f29a002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:36.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 -- 10.20.193.70:0/2586827123 shutdown_connections 2026-02-13T03:45:36.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/2586827123 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f29b0115410 0x7f29b0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/2586827123 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f29b010fbf0 0x7f29b0114c30 unknown :-1 s=CLOSED pgs=307 gs=1 cs=0 l=1 c_cookie=6024229212892447772 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/2586827123 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29b010f200 0x7f29b010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 -- 10.20.193.70:0/2586827123 >> 10.20.193.70:0/2586827123 conn(0x7f29b00ecb00 msgr2=0x7f29b010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 -- 10.20.193.70:0/2586827123 shutdown_connections 2026-02-13T03:45:36.053 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 -- 10.20.193.70:0/2586827123 wait complete. 2026-02-13T03:45:36.054 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 -- 10.20.193.70:0/3284595296 shutdown_connections 2026-02-13T03:45:36.054 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 -- 10.20.193.70:0/3284595296 wait complete. 2026-02-13T03:45:36.054 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 Processor -- start 2026-02-13T03:45:36.054 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 Processor -- start 2026-02-13T03:45:36.054 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f29b62a06c0 1 -- start start 2026-02-13T03:45:36.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.039+0000 7f5862a486c0 1 -- start start 2026-02-13T03:45:36.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b62a06c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f29b010f200 0x7f29b0180140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b62a06c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29b0115410 0x7f29b017d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b62a06c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f29b017d940 0x7f29b017dde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b62a06c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0158e80 con 0x7f29b017d940 2026-02-13T03:45:36.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b62a06c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0158ff0 con 0x7f29b010f200 2026-02-13T03:45:36.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b62a06c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01591b0 con 0x7f29b0115410 2026-02-13T03:45:36.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f5862a486c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c10b1f0 0x7f585c15fbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f5862a486c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f585c10bb00 0x7f585c160120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f5862a486c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f585c153420 0x7f585c1654e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f5862a486c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f585c165b30 con 0x7f585c10b1f0 2026-02-13T03:45:36.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f5862a486c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f585c165ca0 con 0x7f585c153420 2026-02-13T03:45:36.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f5862a486c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f585c165e60 con 0x7f585c10bb00 2026-02-13T03:45:36.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585bfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c10b1f0 0x7f585c15fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585bfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c10b1f0 0x7f585c15fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:34394/0 (socket says 10.20.193.70:34394) 2026-02-13T03:45:36.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585bfff6c0 1 -- 10.20.193.70:0/1770998371 learned_addr learned my addr 10.20.193.70:0/1770998371 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:36.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585b7fe6c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f585c10bb00 0x7f585c160120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b48126c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f29b017d940 0x7f29b017dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29affff6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f29b010f200 0x7f29b0180140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29af7fe6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29b0115410 0x7f29b017d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29af7fe6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29b0115410 0x7f29b017d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.70:57326/0 (socket says 10.20.193.70:57326) 2026-02-13T03:45:36.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29af7fe6c0 1 -- 10.20.193.70:0/1971487059 learned_addr learned my addr 10.20.193.70:0/1971487059 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:36.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29affff6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f29b010f200 0x7f29b0180140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.127:3300/0 says I am v2:10.20.193.70:57372/0 (socket says 10.20.193.70:57372) 2026-02-13T03:45:36.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585bfff6c0 1 -- 10.20.193.70:0/1770998371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f585c10bb00 msgr2=0x7f585c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585bfff6c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f585c10bb00 0x7f585c160120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f5860fba6c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f585c153420 0x7f585c1654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585bfff6c0 1 -- 10.20.193.70:0/1770998371 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f585c153420 msgr2=0x7f585c1654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585bfff6c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f585c153420 0x7f585c1654e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585bfff6c0 1 -- 10.20.193.70:0/1770998371 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5848009590 con 0x7f585c10b1f0 2026-02-13T03:45:36.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f585bfff6c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c10b1f0 0x7f585c15fbe0 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5848004750 tx=0x7f584800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b48126c0 1 -- 10.20.193.70:0/1971487059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29b0115410 msgr2=0x7f29b017d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b48126c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29b0115410 0x7f29b017d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b48126c0 1 -- 10.20.193.70:0/1971487059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f29b010f200 msgr2=0x7f29b0180140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b48126c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f29b010f200 0x7f29b0180140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b48126c0 1 -- 10.20.193.70:0/1971487059 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a0009590 con 0x7f29b017d940 2026-02-13T03:45:36.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29affff6c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f29b010f200 0x7f29b0180140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:45:36.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7f29b48126c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f29b017d940 0x7f29b017dde0 secure :-1 s=READY pgs=310 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29a400c6c0 tx=0x7f29a400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.040+0000 7fcb9d7fa6c0 1 -- 10.20.193.70:0/1523396988 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fcb8c0043b0 con 0x7fcba010d000 2026-02-13T03:45:36.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.041+0000 7fcb9d7fa6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.041+0000 7fcb9f7fe6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.041+0000 7fcb9d7fa6c0 1 -- 10.20.193.70:0/1523396988 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fcb8c0e3b60 con 0x7fcba010d000 2026-02-13T03:45:36.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.041+0000 7fcb9f7fe6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb90005b40 tx=0x7fcb90005c40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.041+0000 7f58597fa6c0 1 -- 10.20.193.70:0/1770998371 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58480044a0 con 0x7f585c10b1f0 2026-02-13T03:45:36.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.041+0000 7f58597fa6c0 1 -- 10.20.193.70:0/1770998371 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5848009030 con 0x7f585c10b1f0 2026-02-13T03:45:36.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.041+0000 7f29ad7fa6c0 1 -- 10.20.193.70:0/1971487059 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29a4005340 con 0x7f29b017d940 2026-02-13T03:45:36.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.042+0000 7f29ad7fa6c0 1 -- 10.20.193.70:0/1971487059 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f29a4003cd0 con 0x7f29b017d940 2026-02-13T03:45:36.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.042+0000 7f29ad7fa6c0 1 -- 10.20.193.70:0/1971487059 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29a400dbf0 con 0x7f29b017d940 2026-02-13T03:45:36.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.041+0000 7f58597fa6c0 1 -- 10.20.193.70:0/1770998371 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f584800ce60 con 0x7f585c10b1f0 2026-02-13T03:45:36.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.042+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585000a5b0 con 0x7f585c10b1f0 2026-02-13T03:45:36.062 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.042+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c10cbf0 con 0x7f585c10b1f0 2026-02-13T03:45:36.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.042+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b0159490 con 0x7f29b017d940 2026-02-13T03:45:36.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.042+0000 7fcb9d7fa6c0 1 -- 10.20.193.70:0/1523396988 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcb8c0a65c0 con 0x7fcba010d000 2026-02-13T03:45:36.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.042+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b0159920 con 0x7f29b017d940 2026-02-13T03:45:36.063 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.042+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585c065120 con 0x7f585c10b1f0 2026-02-13T03:45:36.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.042+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b01104d0 con 0x7f29b017d940 2026-02-13T03:45:36.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.044+0000 7f58597fa6c0 1 -- 10.20.193.70:0/1770998371 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f58480026b0 con 0x7f585c10b1f0 2026-02-13T03:45:36.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.044+0000 7f29ad7fa6c0 1 -- 10.20.193.70:0/1971487059 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f29a4003810 con 0x7f29b017d940 2026-02-13T03:45:36.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.044+0000 7f58597fa6c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f58300b5700 0x7f58300d5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.064 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.044+0000 7f29ad7fa6c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29840b5860 0x7f29840d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.044+0000 7f58597fa6c0 1 -- 10.20.193.70:0/1770998371 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f58480e3d50 con 0x7f585c10b1f0 2026-02-13T03:45:36.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.045+0000 7f585b7fe6c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f58300b5700 0x7f58300d5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.044+0000 7f29ad7fa6c0 1 -- 10.20.193.70:0/1971487059 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f29a40e47f0 con 0x7f29b017d940 2026-02-13T03:45:36.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.044+0000 7f29affff6c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29840b5860 0x7f29840d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.065 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.044+0000 7f29ad7fa6c0 1 -- 10.20.193.70:0/1971487059 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f29a40a7210 con 0x7f29b017d940 2026-02-13T03:45:36.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.045+0000 7f585b7fe6c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f58300b5700 0x7f58300d5bb0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f584c005980 tx=0x7f584c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.045+0000 7f29affff6c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29840b5860 0x7f29840d5d10 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f299c004750 tx=0x7f299c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.046+0000 7f58597fa6c0 1 -- 10.20.193.70:0/1770998371 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f58480a6800 con 0x7f585c10b1f0 2026-02-13T03:45:36.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.048+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f138410f600 con 0x7f138410f230 2026-02-13T03:45:36.066 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.049+0000 7f1372ffd6c0 1 -- 10.20.193.70:0/2069726172 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13740ca640 con 0x7f138410f230 2026-02-13T03:45:36.067 INFO:teuthology.orchestra.run.trial070.stdout:55834574870 2026-02-13T03:45:36.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f13600b5610 msgr2=0x7f13600d5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.067 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f13600b5610 0x7f13600d5ac0 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1384123cb0 tx=0x7f1378009630 comp rx=0 tx=0).stop 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f138410f230 msgr2=0x7f138411d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f138410f230 0x7f138411d320 secure :-1 s=READY pgs=295 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13740099a0 tx=0x7f137402fc00 comp rx=0 tx=0).stop 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 shutdown_connections 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f13600b5610 0x7f13600d5ac0 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1384122c20 0x7f13841230c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1384115440 0x7f138411d860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 --2- 10.20.193.70:0/2069726172 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f138410f230 0x7f138411d320 unknown :-1 s=CLOSED pgs=295 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 >> 10.20.193.70:0/2069726172 conn(0x7f13840ecb30 msgr2=0x7f138410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 shutdown_connections 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.051+0000 7f138c0b46c0 1 -- 10.20.193.70:0/2069726172 wait complete. 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.052+0000 7fbded7fa6c0 1 -- 10.20.193.70:0/2849243600 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbe080fafb0 con 0x7fbe080f5170 2026-02-13T03:45:36.068 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.053+0000 7fbdef7fe6c0 1 -- 10.20.193.70:0/2849243600 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbe080fafb0 con 0x7fbe080f5170 2026-02-13T03:45:36.069 INFO:teuthology.orchestra.run.trial070.stdout:111669149714 2026-02-13T03:45:36.069 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.055+0000 7fbded7fa6c0 1 -- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbde00b5690 msgr2=0x7fbde00d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.069 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.055+0000 7fbded7fa6c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbde00b5690 0x7fbde00d5b40 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdfc004750 tx=0x7fbdfc009260 comp rx=0 tx=0).stop 2026-02-13T03:45:36.069 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.055+0000 7fbded7fa6c0 1 -- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe080f5170 msgr2=0x7fbe080fa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.069 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.055+0000 7fbded7fa6c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe080f5170 0x7fbe080fa440 secure :-1 s=READY pgs=297 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdf8006ea0 tx=0x7fbdf800cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.069 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.057+0000 7fbded7fa6c0 1 -- 10.20.193.70:0/2849243600 shutdown_connections 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.057+0000 7fbded7fa6c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fbde00b5690 0x7fbde00d5b40 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.057+0000 7fbded7fa6c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fbe080f5170 0x7fbe080fa440 unknown :-1 s=CLOSED pgs=297 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.057+0000 7fbded7fa6c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe08115440 0x7fbe08175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.057+0000 7fbded7fa6c0 1 --2- 10.20.193.70:0/2849243600 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fbe0810f230 0x7fbe080f4b40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.057+0000 7fbded7fa6c0 1 -- 10.20.193.70:0/2849243600 >> 10.20.193.70:0/2849243600 conn(0x7fbe080ecb30 msgr2=0x7fbe08113bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.057+0000 7fbded7fa6c0 1 -- 10.20.193.70:0/2849243600 shutdown_connections 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.057+0000 7fbded7fa6c0 1 -- 10.20.193.70:0/2849243600 wait complete. 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.058+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f5eb0160410 con 0x7f5eb0153420 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.058+0000 7f5e9e7fc6c0 1 -- 10.20.193.70:0/1484655775 <== mon.2 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5eac006e60 con 0x7f5eb0153420 2026-02-13T03:45:36.070 INFO:teuthology.orchestra.run.trial070.stdout:201863462925 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e8c0b5710 msgr2=0x7f5e8c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e8c0b5710 0x7f5e8c0d5bc0 secure :-1 s=READY pgs=215 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea0005980 tx=0x7f5ea0009260 comp rx=0 tx=0).stop 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5eb0153420 msgr2=0x7f5eb0164bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5eb0153420 0x7f5eb0164bc0 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5eb010c1d0 tx=0x7f5eac00cb60 comp rx=0 tx=0).stop 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 shutdown_connections 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f5e8c0b5710 0x7f5e8c0d5bc0 unknown :-1 s=CLOSED pgs=215 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f5eb0153420 0x7f5eb0164bc0 unknown :-1 s=CLOSED pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5eb010bb00 0x7f5eb015f800 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 --2- 10.20.193.70:0/1484655775 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f5eb010b1f0 0x7f5eb015f2c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 >> 10.20.193.70:0/1484655775 conn(0x7f5eb0063af0 msgr2=0x7f5eb010a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 shutdown_connections 2026-02-13T03:45:36.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.060+0000 7f5eb77076c0 1 -- 10.20.193.70:0/1484655775 wait complete. 2026-02-13T03:45:36.096 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051601 got 124554051601 for osd.5 2026-02-13T03:45:36.096 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/2654906262 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb77810cfb0 msgr2=0x7fb77810d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/2654906262 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb77810cfb0 0x7fb77810d380 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=313401727854082489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7680099a0 tx=0x7fb76802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:36.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/2654906262 shutdown_connections 2026-02-13T03:45:36.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/2654906262 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb7781131c0 0x7fb778173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/2654906262 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb77810d9a0 0x7fb7781129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/2654906262 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb77810cfb0 0x7fb77810d380 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=313401727854082489 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/2654906262 >> 10.20.193.70:0/2654906262 conn(0x7fb7780ea8b0 msgr2=0x7fb77810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/2654906262 shutdown_connections 2026-02-13T03:45:36.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/2654906262 wait complete. 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 Processor -- start 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.095+0000 7fb77fffb6c0 1 -- start start 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77fffb6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb77810cfb0 0x7fb77811b030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77fffb6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb7781131c0 0x7fb77811b570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77fffb6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb778120930 0x7fb778120dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77fffb6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb778121340 con 0x7fb778120930 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77fffb6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781214b0 con 0x7fb77810cfb0 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77fffb6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb778121670 con 0x7fb7781131c0 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77e56d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb778120930 0x7fb778120dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.099 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77e56d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb778120930 0x7fb778120dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:39878/0 (socket says 10.20.193.70:39878) 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77e56d6c0 1 -- 10.20.193.70:0/4262563177 learned_addr learned my addr 10.20.193.70:0/4262563177 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77d56b6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb7781131c0 0x7fb77811b570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77e56d6c0 1 -- 10.20.193.70:0/4262563177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb7781131c0 msgr2=0x7fb77811b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77e56d6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb7781131c0 0x7fb77811b570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77e56d6c0 1 -- 10.20.193.70:0/4262563177 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb77810cfb0 msgr2=0x7fb77811b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77e56d6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb77810cfb0 0x7fb77811b030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77e56d6c0 1 -- 10.20.193.70:0/4262563177 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb768009590 con 0x7fb778120930 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77e56d6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb778120930 0x7fb778120dd0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb774006ea0 tx=0x7fb77400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb766ffd6c0 1 -- 10.20.193.70:0/4262563177 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb774003c40 con 0x7fb778120930 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb766ffd6c0 1 -- 10.20.193.70:0/4262563177 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb774003da0 con 0x7fb778120930 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb778161b20 con 0x7fb778120930 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb766ffd6c0 1 -- 10.20.193.70:0/4262563177 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7740081c0 con 0x7fb778120930 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.096+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb778161f50 con 0x7fb778120930 2026-02-13T03:45:36.100 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.097+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77810e280 con 0x7fb778120930 2026-02-13T03:45:36.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.098+0000 7fb766ffd6c0 1 -- 10.20.193.70:0/4262563177 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fb774005860 con 0x7fb778120930 2026-02-13T03:45:36.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.099+0000 7fb766ffd6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb7540b5690 0x7fb7540d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.099+0000 7fb766ffd6c0 1 -- 10.20.193.70:0/4262563177 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fb7740e4c20 con 0x7fb778120930 2026-02-13T03:45:36.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.099+0000 7fb77dd6c6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb7540b5690 0x7fb7540d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.099+0000 7fb77dd6c6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb7540b5690 0x7fb7540d5b40 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7680098c0 tx=0x7fb768005bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.101 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.099+0000 7fb766ffd6c0 1 -- 10.20.193.70:0/4262563177 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb7740a7680 con 0x7fb778120930 2026-02-13T03:45:36.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.109+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f1e340f3b70 con 0x7f1e341131c0 2026-02-13T03:45:36.111 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.110+0000 7f1e1b7fe6c0 1 -- 10.20.193.70:0/4041774816 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1e280cd4f0 con 0x7f1e341131c0 2026-02-13T03:45:36.112 INFO:teuthology.orchestra.run.trial070.stdout:231928233995 2026-02-13T03:45:36.113 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574869 got 55834574870 for osd.2 2026-02-13T03:45:36.114 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.114 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149713 got 111669149714 for osd.4 2026-02-13T03:45:36.115 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.115 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1e100b5790 msgr2=0x7f1e100d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1e100b5790 0x7f1e100d5c40 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e240095c0 tx=0x7f1e24009260 comp rx=0 tx=0).stop 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e341131c0 msgr2=0x7f1e34173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e341131c0 0x7f1e34173a60 secure :-1 s=READY pgs=299 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e28009970 tx=0x7f1e28031f50 comp rx=0 tx=0).stop 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 shutdown_connections 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1e100b5790 0x7f1e100d5c40 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e340f3050 0x7f1e340f8320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e341131c0 0x7f1e34173a60 unknown :-1 s=CLOSED pgs=299 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 --2- 10.20.193.70:0/4041774816 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e3410cfb0 0x7f1e340f2a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 >> 10.20.193.70:0/4041774816 conn(0x7f1e340ea8b0 msgr2=0x7f1e3410f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.116 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 shutdown_connections 2026-02-13T03:45:36.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.112+0000 7f1e3c7486c0 1 -- 10.20.193.70:0/4041774816 wait complete. 2026-02-13T03:45:36.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.113+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9d940f3430 con 0x7f9d940622d0 2026-02-13T03:45:36.117 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.114+0000 7f9d7b7fe6c0 1 -- 10.20.193.70:0/221794258 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d7c0a97c0 con 0x7f9d940622d0 2026-02-13T03:45:36.118 INFO:teuthology.orchestra.run.trial070.stdout:81604378644 2026-02-13T03:45:36.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.115+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f18e00008e0 con 0x7f18e00675f0 2026-02-13T03:45:36.118 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.115+0000 7f18c77fe6c0 1 -- 10.20.193.70:0/2485601427 <== mon.2 v2:10.20.193.127:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f18d40a9450 con 0x7f18e00675f0 2026-02-13T03:45:36.119 INFO:teuthology.orchestra.run.trial070.stdout:154618822672 2026-02-13T03:45:36.119 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9d6c0b5690 msgr2=0x7f9d6c0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9d6c0b5690 0x7f9d6c0d5b40 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d88005fd0 tx=0x7f9d88009650 comp rx=0 tx=0).stop 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d940622d0 msgr2=0x7f9d940f2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d940622d0 0x7f9d940f2820 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d7c009490 tx=0x7f9d7c00bc50 comp rx=0 tx=0).stop 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 shutdown_connections 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9d6c0b5690 0x7f9d6c0d5b40 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d94159af0 0x7f9d940f7be0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9d940622d0 0x7f9d940f2820 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 --2- 10.20.193.70:0/221794258 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9d94060ce0 0x7f9d940f22e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 >> 10.20.193.70:0/221794258 conn(0x7f9d940ea8b0 msgr2=0x7f9d9410efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.120 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 shutdown_connections 2026-02-13T03:45:36.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.117+0000 7f9d98fac6c0 1 -- 10.20.193.70:0/221794258 wait complete. 2026-02-13T03:45:36.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18bc0b57e0 msgr2=0x7f18bc0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.121 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18bc0b57e0 0x7f18bc0d5c90 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18d0004750 tx=0x7f18d0009310 comp rx=0 tx=0).stop 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18e00675f0 msgr2=0x7f18e0165e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18e00675f0 0x7f18e0165e20 secure :-1 s=READY pgs=59 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18d400b6c0 tx=0x7f18d400bb90 comp rx=0 tx=0).stop 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 shutdown_connections 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18bc0b57e0 0x7f18bc0d5c90 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f18e0159b20 0x7f18e016b1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f18e00675f0 0x7f18e0165e20 unknown :-1 s=CLOSED pgs=59 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 --2- 10.20.193.70:0/2485601427 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18e0066ce0 0x7f18e01658e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 >> 10.20.193.70:0/2485601427 conn(0x7f18e0064810 msgr2=0x7f18e015c060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 shutdown_connections 2026-02-13T03:45:36.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.118+0000 7f18e85d16c0 1 -- 10.20.193.70:0/2485601427 wait complete. 2026-02-13T03:45:36.123 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462925 got 201863462925 for osd.8 2026-02-13T03:45:36.124 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.152 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.150+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f699c10f600 con 0x7f699c10f230 2026-02-13T03:45:36.153 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.150+0000 7f698a7fc6c0 1 -- 10.20.193.70:0/1421054202 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f698c0a95d0 con 0x7f699c10f230 2026-02-13T03:45:36.153 INFO:teuthology.orchestra.run.trial070.stdout:30064771097 2026-02-13T03:45:36.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f69780b5690 msgr2=0x7f69780d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f69780b5690 0x7f69780d5b40 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6990009260 tx=0x7f69900023a0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10f230 msgr2=0x7f699c0f4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.155 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10f230 0x7f699c0f4d60 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f698c009490 tx=0x7f698c00bca0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 shutdown_connections 2026-02-13T03:45:36.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f69780b5690 0x7f69780d5b40 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c0f5390 0x7f699c0fa660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f699c115440 0x7f699c175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 --2- 10.20.193.70:0/1421054202 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f699c10f230 0x7f699c0f4d60 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 >> 10.20.193.70:0/1421054202 conn(0x7f699c0ecb30 msgr2=0x7f699c10da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 shutdown_connections 2026-02-13T03:45:36.156 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.153+0000 7f69a371c6c0 1 -- 10.20.193.70:0/1421054202 wait complete. 2026-02-13T03:45:36.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.157+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fcba0118bb0 con 0x7fcba010d000 2026-02-13T03:45:36.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.158+0000 7fcb9d7fa6c0 1 -- 10.20.193.70:0/1523396988 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcb8c0a9770 con 0x7fcba010d000 2026-02-13T03:45:36.160 INFO:teuthology.orchestra.run.trial070.stdout:279172874249 2026-02-13T03:45:36.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.160+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 msgr2=0x7fcb740d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.160+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb90005b40 tx=0x7fcb90005c40 comp rx=0 tx=0).stop 2026-02-13T03:45:36.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.160+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d000 msgr2=0x7fcba0117a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.160+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d000 0x7fcba0117a00 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb8c00b710 tx=0x7fcb8c00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f29b017e6e0 con 0x7f29b017d940 2026-02-13T03:45:36.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 shutdown_connections 2026-02-13T03:45:36.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fcb740b5710 0x7fcb740d5bc0 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcba011d300 0x7fcba011d7a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fcba01131c0 0x7fcba0117f40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7fcba673c6c0 1 --2- 10.20.193.70:0/1523396988 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fcba010d000 0x7fcba0117a00 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 >> 10.20.193.70:0/1523396988 conn(0x7fcba0065870 msgr2=0x7fcba0111840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 shutdown_connections 2026-02-13T03:45:36.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7f29ad7fa6c0 1 -- 10.20.193.70:0/1971487059 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f29a40aa3c0 con 0x7f29b017d940 2026-02-13T03:45:36.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.161+0000 7fcba673c6c0 1 -- 10.20.193.70:0/1523396988 wait complete. 2026-02-13T03:45:36.165 INFO:teuthology.orchestra.run.trial070.stdout:249108103178 2026-02-13T03:45:36.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f585c160d30 con 0x7f585c10b1f0 2026-02-13T03:45:36.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f58597fa6c0 1 -- 10.20.193.70:0/1770998371 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58480a9920 con 0x7f585c10b1f0 2026-02-13T03:45:36.166 INFO:teuthology.orchestra.run.trial070.stdout:42949672982 2026-02-13T03:45:36.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29840b5860 msgr2=0x7f29840d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29840b5860 0x7f29840d5d10 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f299c004750 tx=0x7f299c009260 comp rx=0 tx=0).stop 2026-02-13T03:45:36.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f29b017d940 msgr2=0x7f29b017dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f29b017d940 0x7f29b017dde0 secure :-1 s=READY pgs=310 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29a400c6c0 tx=0x7f29a400cb90 comp rx=0 tx=0).stop 2026-02-13T03:45:36.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 shutdown_connections 2026-02-13T03:45:36.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29840b5860 0x7f29840d5d10 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f29b017d940 0x7f29b017dde0 unknown :-1 s=CLOSED pgs=310 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29b0115410 0x7f29b017d3b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 --2- 10.20.193.70:0/1971487059 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f29b010f200 0x7f29b0180140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 >> 10.20.193.70:0/1971487059 conn(0x7f29b00ecb00 msgr2=0x7f29b010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 shutdown_connections 2026-02-13T03:45:36.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.163+0000 7f29b62a06c0 1 -- 10.20.193.70:0/1971487059 wait complete. 2026-02-13T03:45:36.169 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928233995 got 231928233995 for osd.9 2026-02-13T03:45:36.170 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.170 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f58300b5700 msgr2=0x7f58300d5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f58300b5700 0x7f58300d5bb0 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f584c005980 tx=0x7f584c005910 comp rx=0 tx=0).stop 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c10b1f0 msgr2=0x7f585c15fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c10b1f0 0x7f585c15fbe0 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5848004750 tx=0x7f584800be00 comp rx=0 tx=0).stop 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 shutdown_connections 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f58300b5700 0x7f58300d5bb0 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f585c153420 0x7f585c1654e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f585c10bb00 0x7f585c160120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 --2- 10.20.193.70:0/1770998371 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f585c10b1f0 0x7f585c15fbe0 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 >> 10.20.193.70:0/1770998371 conn(0x7f585c063af0 msgr2=0x7f585c10a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 shutdown_connections 2026-02-13T03:45:36.171 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.166+0000 7f5862a486c0 1 -- 10.20.193.70:0/1770998371 wait complete. 2026-02-13T03:45:36.174 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822672 got 154618822672 for osd.6 2026-02-13T03:45:36.175 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.183 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378644 got 81604378644 for osd.3 2026-02-13T03:45:36.183 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.205 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.203+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb77810d380 con 0x7fb778120930 2026-02-13T03:45:36.205 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.203+0000 7fb766ffd6c0 1 -- 10.20.193.70:0/4262563177 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb7740aa830 con 0x7fb778120930 2026-02-13T03:45:36.206 INFO:teuthology.orchestra.run.trial070.stdout:171798691853 2026-02-13T03:45:36.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb7540b5690 msgr2=0x7fb7540d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb7540b5690 0x7fb7540d5b40 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7680098c0 tx=0x7fb768005bc0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb778120930 msgr2=0x7fb778120dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb778120930 0x7fb778120dd0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb774006ea0 tx=0x7fb77400ce50 comp rx=0 tx=0).stop 2026-02-13T03:45:36.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 shutdown_connections 2026-02-13T03:45:36.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb7540b5690 0x7fb7540d5b40 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb778120930 0x7fb778120dd0 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb7781131c0 0x7fb77811b570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 --2- 10.20.193.70:0/4262563177 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb77810cfb0 0x7fb77811b030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 >> 10.20.193.70:0/4262563177 conn(0x7fb7780ea8b0 msgr2=0x7fb77810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 shutdown_connections 2026-02-13T03:45:36.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.206+0000 7fb77fffb6c0 1 -- 10.20.193.70:0/4262563177 wait complete. 2026-02-13T03:45:36.217 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874249 got 279172874249 for osd.11 2026-02-13T03:45:36.218 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.222 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103178 got 249108103178 for osd.10 2026-02-13T03:45:36.222 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.226 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672982 got 42949672982 for osd.1 2026-02-13T03:45:36.226 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.230 INFO:tasks.cephadm.ceph_manager.ceph:need seq 30064771096 got 30064771097 for osd.0 2026-02-13T03:45:36.230 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.251 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691853 got 171798691853 for osd.7 2026-02-13T03:45:36.252 DEBUG:teuthology.parallel:result is None 2026-02-13T03:45:36.252 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T03:45:36.252 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T03:45:36.407 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:36.523 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 -- 10.20.193.70:0/2338015186 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800114190 msgr2=0x7ff800119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.523 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 --2- 10.20.193.70:0/2338015186 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800114190 0x7ff800119140 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=8496318181156016551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7f0009970 tx=0x7ff7f002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:36.523 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 -- 10.20.193.70:0/2338015186 shutdown_connections 2026-02-13T03:45:36.523 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 --2- 10.20.193.70:0/2338015186 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8001198f0 0x7ff80017a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 --2- 10.20.193.70:0/2338015186 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800114190 0x7ff800119140 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=8496318181156016551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 --2- 10.20.193.70:0/2338015186 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8001137a0 0x7ff800113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 -- 10.20.193.70:0/2338015186 >> 10.20.193.70:0/2338015186 conn(0x7ff800060760 msgr2=0x7ff800060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 -- 10.20.193.70:0/2338015186 shutdown_connections 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 -- 10.20.193.70:0/2338015186 wait complete. 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 Processor -- start 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 -- start start 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8001137a0 0x7ff800121830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8001198f0 0x7ff800121d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800127130 0x7ff8001275d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.524 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff800127b40 con 0x7ff800127130 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff800127cb0 con 0x7ff8001137a0 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.519+0000 7ff8064886c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff800127e70 con 0x7ff8001198f0 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8049fa6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800127130 0x7ff8001275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8049fa6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800127130 0x7ff8001275d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:39906/0 (socket says 10.20.193.70:39906) 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8049fa6c0 1 -- 10.20.193.70:0/3441883714 learned_addr learned my addr 10.20.193.70:0/3441883714 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff7ff7fe6c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8001198f0 0x7ff800121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff7fffff6c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8001137a0 0x7ff800121830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8049fa6c0 1 -- 10.20.193.70:0/3441883714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8001198f0 msgr2=0x7ff800121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8049fa6c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8001198f0 0x7ff800121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8049fa6c0 1 -- 10.20.193.70:0/3441883714 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8001137a0 msgr2=0x7ff800121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.525 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8049fa6c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8001137a0 0x7ff800121830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.526 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8049fa6c0 1 -- 10.20.193.70:0/3441883714 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f0009590 con 0x7ff800127130 2026-02-13T03:45:36.526 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8049fa6c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800127130 0x7ff8001275d0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7f4006ea0 tx=0x7ff7f400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.526 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff7fd7fa6c0 1 -- 10.20.193.70:0/3441883714 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7f4003a30 con 0x7ff800127130 2026-02-13T03:45:36.526 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff800168320 con 0x7ff800127130 2026-02-13T03:45:36.526 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff7fd7fa6c0 1 -- 10.20.193.70:0/3441883714 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff7f40054f0 con 0x7ff800127130 2026-02-13T03:45:36.526 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff7fd7fa6c0 1 -- 10.20.193.70:0/3441883714 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7f400dcd0 con 0x7ff800127130 2026-02-13T03:45:36.526 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff800168800 con 0x7ff800127130 2026-02-13T03:45:36.526 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.520+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8001149e0 con 0x7ff800127130 2026-02-13T03:45:36.527 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.522+0000 7ff7fd7fa6c0 1 -- 10.20.193.70:0/3441883714 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7ff7f4005030 con 0x7ff800127130 2026-02-13T03:45:36.527 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.522+0000 7ff7fd7fa6c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff7d40b5690 0x7ff7d40d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.527 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.522+0000 7ff7fffff6c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff7d40b5690 0x7ff7d40d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.528 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.523+0000 7ff7fd7fa6c0 1 -- 10.20.193.70:0/3441883714 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7ff7f40e4c20 con 0x7ff800127130 2026-02-13T03:45:36.528 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.523+0000 7ff7fd7fa6c0 1 -- 10.20.193.70:0/3441883714 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff7f40a7680 con 0x7ff800127130 2026-02-13T03:45:36.528 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.523+0000 7ff7fffff6c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff7d40b5690 0x7ff7d40d5b40 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7ec005980 tx=0x7ff7ec005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.617 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.615+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff800113b70 con 0x7ff7d40b5690 2026-02-13T03:45:36.619 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.617+0000 7ff7fd7fa6c0 1 -- 10.20.193.70:0/3441883714 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258898 (secure 0 0 0) 0x7ff800113b70 con 0x7ff7d40b5690 2026-02-13T03:45:36.623 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:36.624 INFO:teuthology.orchestra.run.trial070.stderr:dumped all 2026-02-13T03:45:36.626 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff7d40b5690 msgr2=0x7ff7d40d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff7d40b5690 0x7ff7d40d5b40 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7ec005980 tx=0x7ff7ec005910 comp rx=0 tx=0).stop 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800127130 msgr2=0x7ff8001275d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800127130 0x7ff8001275d0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7f4006ea0 tx=0x7ff7f400cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 shutdown_connections 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff7d40b5690 0x7ff7d40d5b40 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff800127130 0x7ff8001275d0 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8001198f0 0x7ff800121d70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 --2- 10.20.193.70:0/3441883714 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff8001137a0 0x7ff800121830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 >> 10.20.193.70:0/3441883714 conn(0x7ff800060760 msgr2=0x7ff800117fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 shutdown_connections 2026-02-13T03:45:36.627 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.619+0000 7ff8064886c0 1 -- 10.20.193.70:0/3441883714 wait complete. 2026-02-13T03:45:36.663 INFO:teuthology.orchestra.run.trial070.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2026-02-13T03:45:35.782355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645426,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":133,"num_read_kb":160,"num_write":257,"num_write_kb":3799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":332868,"kb_used_data":9300,"kb_used_omap":309,"kb_used_meta":323018,"kb_avail":8807705532,"statfs":{"total":9019431321600,"available":9019090464768,"internally_reserved":0,"allocated":9523200,"data_stored":6316998,"data_compressed":114213,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":316953,"internal_metadata":330770919},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55024,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":27,"num_read_kb":69,"num_write":65,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.436017"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347727+0000","last_change":"2026-02-13T03:45:24.355427+0000","last_active":"2026-02-13T03:45:25.347727+0000","last_peered":"2026-02-13T03:45:25.347727+0000","last_clean":"2026-02-13T03:45:25.347727+0000","last_became_active":"2026-02-13T03:45:24.354772+0000","last_became_peered":"2026-02-13T03:45:24.354772+0000","last_unstale":"2026-02-13T03:45:25.347727+0000","last_undegraded":"2026-02-13T03:45:25.347727+0000","last_fullsized":"2026-02-13T03:45:25.347727+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:09.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636233+0000","last_change":"2026-02-13T03:45:24.354062+0000","last_active":"2026-02-13T03:45:25.636233+0000","last_peered":"2026-02-13T03:45:25.636233+0000","last_clean":"2026-02-13T03:45:25.636233+0000","last_became_active":"2026-02-13T03:45:24.353476+0000","last_became_peered":"2026-02-13T03:45:24.353476+0000","last_unstale":"2026-02-13T03:45:25.636233+0000","last_undegraded":"2026-02-13T03:45:25.636233+0000","last_fullsized":"2026-02-13T03:45:25.636233+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:02:42.376217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636183+0000","last_change":"2026-02-13T03:45:24.353519+0000","last_active":"2026-02-13T03:45:25.636183+0000","last_peered":"2026-02-13T03:45:25.636183+0000","last_clean":"2026-02-13T03:45:25.636183+0000","last_became_active":"2026-02-13T03:45:24.352727+0000","last_became_peered":"2026-02-13T03:45:24.352727+0000","last_unstale":"2026-02-13T03:45:25.636183+0000","last_undegraded":"2026-02-13T03:45:25.636183+0000","last_fullsized":"2026-02-13T03:45:25.636183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:37:43.862075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348181+0000","last_change":"2026-02-13T03:45:24.353099+0000","last_active":"2026-02-13T03:45:25.348181+0000","last_peered":"2026-02-13T03:45:25.348181+0000","last_clean":"2026-02-13T03:45:25.348181+0000","last_became_active":"2026-02-13T03:45:24.352744+0000","last_became_peered":"2026-02-13T03:45:24.352744+0000","last_unstale":"2026-02-13T03:45:25.348181+0000","last_undegraded":"2026-02-13T03:45:25.348181+0000","last_fullsized":"2026-02-13T03:45:25.348181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:10:58.697391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927950+0000","last_change":"2026-02-13T03:45:24.352238+0000","last_active":"2026-02-13T03:45:25.927950+0000","last_peered":"2026-02-13T03:45:25.927950+0000","last_clean":"2026-02-13T03:45:25.927950+0000","last_became_active":"2026-02-13T03:45:24.352093+0000","last_became_peered":"2026-02-13T03:45:24.352093+0000","last_unstale":"2026-02-13T03:45:25.927950+0000","last_undegraded":"2026-02-13T03:45:25.927950+0000","last_fullsized":"2026-02-13T03:45:25.927950+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:40:14.634462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186270+0000","last_change":"2026-02-13T03:45:24.356372+0000","last_active":"2026-02-13T03:45:26.186270+0000","last_peered":"2026-02-13T03:45:26.186270+0000","last_clean":"2026-02-13T03:45:26.186270+0000","last_became_active":"2026-02-13T03:45:24.356087+0000","last_became_peered":"2026-02-13T03:45:24.356087+0000","last_unstale":"2026-02-13T03:45:26.186270+0000","last_undegraded":"2026-02-13T03:45:26.186270+0000","last_fullsized":"2026-02-13T03:45:26.186270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:35:30.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421404+0000","last_change":"2026-02-13T03:45:24.356259+0000","last_active":"2026-02-13T03:45:25.421404+0000","last_peered":"2026-02-13T03:45:25.421404+0000","last_clean":"2026-02-13T03:45:25.421404+0000","last_became_active":"2026-02-13T03:45:24.356054+0000","last_became_peered":"2026-02-13T03:45:24.356054+0000","last_unstale":"2026-02-13T03:45:25.421404+0000","last_undegraded":"2026-02-13T03:45:25.421404+0000","last_fullsized":"2026-02-13T03:45:25.421404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:41:54.530855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850055+0000","last_change":"2026-02-13T03:45:24.355402+0000","last_active":"2026-02-13T03:45:25.850055+0000","last_peered":"2026-02-13T03:45:25.850055+0000","last_clean":"2026-02-13T03:45:25.850055+0000","last_became_active":"2026-02-13T03:45:24.355240+0000","last_became_peered":"2026-02-13T03:45:24.355240+0000","last_unstale":"2026-02-13T03:45:25.850055+0000","last_undegraded":"2026-02-13T03:45:25.850055+0000","last_fullsized":"2026-02-13T03:45:25.850055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:41:11.797331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170279+0000","last_change":"2026-02-13T03:45:24.354542+0000","last_active":"2026-02-13T03:45:26.170279+0000","last_peered":"2026-02-13T03:45:26.170279+0000","last_clean":"2026-02-13T03:45:26.170279+0000","last_became_active":"2026-02-13T03:45:24.354387+0000","last_became_peered":"2026-02-13T03:45:24.354387+0000","last_unstale":"2026-02-13T03:45:26.170279+0000","last_undegraded":"2026-02-13T03:45:26.170279+0000","last_fullsized":"2026-02-13T03:45:26.170279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:45:32.036800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186512+0000","last_change":"2026-02-13T03:45:24.356533+0000","last_active":"2026-02-13T03:45:26.186512+0000","last_peered":"2026-02-13T03:45:26.186512+0000","last_clean":"2026-02-13T03:45:26.186512+0000","last_became_active":"2026-02-13T03:45:24.356262+0000","last_became_peered":"2026-02-13T03:45:24.356262+0000","last_unstale":"2026-02-13T03:45:26.186512+0000","last_undegraded":"2026-02-13T03:45:26.186512+0000","last_fullsized":"2026-02-13T03:45:26.186512+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:10:24.614545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421980+0000","last_change":"2026-02-13T03:45:24.354428+0000","last_active":"2026-02-13T03:45:25.421980+0000","last_peered":"2026-02-13T03:45:25.421980+0000","last_clean":"2026-02-13T03:45:25.421980+0000","last_became_active":"2026-02-13T03:45:24.354241+0000","last_became_peered":"2026-02-13T03:45:24.354241+0000","last_unstale":"2026-02-13T03:45:25.421980+0000","last_undegraded":"2026-02-13T03:45:25.421980+0000","last_fullsized":"2026-02-13T03:45:25.421980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:31.625314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348111+0000","last_change":"2026-02-13T03:45:24.353689+0000","last_active":"2026-02-13T03:45:25.348111+0000","last_peered":"2026-02-13T03:45:25.348111+0000","last_clean":"2026-02-13T03:45:25.348111+0000","last_became_active":"2026-02-13T03:45:24.353518+0000","last_became_peered":"2026-02-13T03:45:24.353518+0000","last_unstale":"2026-02-13T03:45:25.348111+0000","last_undegraded":"2026-02-13T03:45:25.348111+0000","last_fullsized":"2026-02-13T03:45:25.348111+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:20:01.588601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186445+0000","last_change":"2026-02-13T03:45:24.353765+0000","last_active":"2026-02-13T03:45:26.186445+0000","last_peered":"2026-02-13T03:45:26.186445+0000","last_clean":"2026-02-13T03:45:26.186445+0000","last_became_active":"2026-02-13T03:45:24.353522+0000","last_became_peered":"2026-02-13T03:45:24.353522+0000","last_unstale":"2026-02-13T03:45:26.186445+0000","last_undegraded":"2026-02-13T03:45:26.186445+0000","last_fullsized":"2026-02-13T03:45:26.186445+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:46:34.122311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.635973+0000","last_change":"2026-02-13T03:45:24.353969+0000","last_active":"2026-02-13T03:45:25.635973+0000","last_peered":"2026-02-13T03:45:25.635973+0000","last_clean":"2026-02-13T03:45:25.635973+0000","last_became_active":"2026-02-13T03:45:24.353461+0000","last_became_peered":"2026-02-13T03:45:24.353461+0000","last_unstale":"2026-02-13T03:45:25.635973+0000","last_undegraded":"2026-02-13T03:45:25.635973+0000","last_fullsized":"2026-02-13T03:45:25.635973+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:37.206875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.635946+0000","last_change":"2026-02-13T03:45:24.349803+0000","last_active":"2026-02-13T03:45:25.635946+0000","last_peered":"2026-02-13T03:45:25.635946+0000","last_clean":"2026-02-13T03:45:25.635946+0000","last_became_active":"2026-02-13T03:45:24.349591+0000","last_became_peered":"2026-02-13T03:45:24.349591+0000","last_unstale":"2026-02-13T03:45:25.635946+0000","last_undegraded":"2026-02-13T03:45:25.635946+0000","last_fullsized":"2026-02-13T03:45:25.635946+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:37:18.195235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170120+0000","last_change":"2026-02-13T03:45:24.353411+0000","last_active":"2026-02-13T03:45:26.170120+0000","last_peered":"2026-02-13T03:45:26.170120+0000","last_clean":"2026-02-13T03:45:26.170120+0000","last_became_active":"2026-02-13T03:45:24.353278+0000","last_became_peered":"2026-02-13T03:45:24.353278+0000","last_unstale":"2026-02-13T03:45:26.170120+0000","last_undegraded":"2026-02-13T03:45:26.170120+0000","last_fullsized":"2026-02-13T03:45:26.170120+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:49.049280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347746+0000","last_change":"2026-02-13T03:45:24.355567+0000","last_active":"2026-02-13T03:45:25.347746+0000","last_peered":"2026-02-13T03:45:25.347746+0000","last_clean":"2026-02-13T03:45:25.347746+0000","last_became_active":"2026-02-13T03:45:24.354971+0000","last_became_peered":"2026-02-13T03:45:24.354971+0000","last_unstale":"2026-02-13T03:45:25.347746+0000","last_undegraded":"2026-02-13T03:45:25.347746+0000","last_fullsized":"2026-02-13T03:45:25.347746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:35:23.426524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347236+0000","last_change":"2026-02-13T03:45:24.355317+0000","last_active":"2026-02-13T03:45:25.347236+0000","last_peered":"2026-02-13T03:45:25.347236+0000","last_clean":"2026-02-13T03:45:25.347236+0000","last_became_active":"2026-02-13T03:45:24.355131+0000","last_became_peered":"2026-02-13T03:45:24.355131+0000","last_unstale":"2026-02-13T03:45:25.347236+0000","last_undegraded":"2026-02-13T03:45:25.347236+0000","last_fullsized":"2026-02-13T03:45:25.347236+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:02.617097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186145+0000","last_change":"2026-02-13T03:45:24.354455+0000","last_active":"2026-02-13T03:45:26.186145+0000","last_peered":"2026-02-13T03:45:26.186145+0000","last_clean":"2026-02-13T03:45:26.186145+0000","last_became_active":"2026-02-13T03:45:24.353604+0000","last_became_peered":"2026-02-13T03:45:24.353604+0000","last_unstale":"2026-02-13T03:45:26.186145+0000","last_undegraded":"2026-02-13T03:45:26.186145+0000","last_fullsized":"2026-02-13T03:45:26.186145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:48:18.147862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347614+0000","last_change":"2026-02-13T03:45:24.353184+0000","last_active":"2026-02-13T03:45:25.347614+0000","last_peered":"2026-02-13T03:45:25.347614+0000","last_clean":"2026-02-13T03:45:25.347614+0000","last_became_active":"2026-02-13T03:45:24.352982+0000","last_became_peered":"2026-02-13T03:45:24.352982+0000","last_unstale":"2026-02-13T03:45:25.347614+0000","last_undegraded":"2026-02-13T03:45:25.347614+0000","last_fullsized":"2026-02-13T03:45:25.347614+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:42.997383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186389+0000","last_change":"2026-02-13T03:45:24.353667+0000","last_active":"2026-02-13T03:45:26.186389+0000","last_peered":"2026-02-13T03:45:26.186389+0000","last_clean":"2026-02-13T03:45:26.186389+0000","last_became_active":"2026-02-13T03:45:24.353361+0000","last_became_peered":"2026-02-13T03:45:24.353361+0000","last_unstale":"2026-02-13T03:45:26.186389+0000","last_undegraded":"2026-02-13T03:45:26.186389+0000","last_fullsized":"2026-02-13T03:45:26.186389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:56:51.287334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170246+0000","last_change":"2026-02-13T03:45:24.354416+0000","last_active":"2026-02-13T03:45:26.170246+0000","last_peered":"2026-02-13T03:45:26.170246+0000","last_clean":"2026-02-13T03:45:26.170246+0000","last_became_active":"2026-02-13T03:45:24.354207+0000","last_became_peered":"2026-02-13T03:45:24.354207+0000","last_unstale":"2026-02-13T03:45:26.170246+0000","last_undegraded":"2026-02-13T03:45:26.170246+0000","last_fullsized":"2026-02-13T03:45:26.170246+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:06:10.307319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850064+0000","last_change":"2026-02-13T03:45:24.354597+0000","last_active":"2026-02-13T03:45:25.850064+0000","last_peered":"2026-02-13T03:45:25.850064+0000","last_clean":"2026-02-13T03:45:25.850064+0000","last_became_active":"2026-02-13T03:45:24.354310+0000","last_became_peered":"2026-02-13T03:45:24.354310+0000","last_unstale":"2026-02-13T03:45:25.850064+0000","last_undegraded":"2026-02-13T03:45:25.850064+0000","last_fullsized":"2026-02-13T03:45:25.850064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:55.801674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791080+0000","last_change":"2026-02-13T03:45:24.355114+0000","last_active":"2026-02-13T03:45:25.791080+0000","last_peered":"2026-02-13T03:45:25.791080+0000","last_clean":"2026-02-13T03:45:25.791080+0000","last_became_active":"2026-02-13T03:45:24.353783+0000","last_became_peered":"2026-02-13T03:45:24.353783+0000","last_unstale":"2026-02-13T03:45:25.791080+0000","last_undegraded":"2026-02-13T03:45:25.791080+0000","last_fullsized":"2026-02-13T03:45:25.791080+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:42.747894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850333+0000","last_change":"2026-02-13T03:45:24.356301+0000","last_active":"2026-02-13T03:45:25.850333+0000","last_peered":"2026-02-13T03:45:25.850333+0000","last_clean":"2026-02-13T03:45:25.850333+0000","last_became_active":"2026-02-13T03:45:24.356101+0000","last_became_peered":"2026-02-13T03:45:24.356101+0000","last_unstale":"2026-02-13T03:45:25.850333+0000","last_undegraded":"2026-02-13T03:45:25.850333+0000","last_fullsized":"2026-02-13T03:45:25.850333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:02:39.812365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186262+0000","last_change":"2026-02-13T03:45:24.354631+0000","last_active":"2026-02-13T03:45:26.186262+0000","last_peered":"2026-02-13T03:45:26.186262+0000","last_clean":"2026-02-13T03:45:26.186262+0000","last_became_active":"2026-02-13T03:45:24.354306+0000","last_became_peered":"2026-02-13T03:45:24.354306+0000","last_unstale":"2026-02-13T03:45:26.186262+0000","last_undegraded":"2026-02-13T03:45:26.186262+0000","last_fullsized":"2026-02-13T03:45:26.186262+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:57.612589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347635+0000","last_change":"2026-02-13T03:45:24.354688+0000","last_active":"2026-02-13T03:45:25.347635+0000","last_peered":"2026-02-13T03:45:25.347635+0000","last_clean":"2026-02-13T03:45:25.347635+0000","last_became_active":"2026-02-13T03:45:24.354555+0000","last_became_peered":"2026-02-13T03:45:24.354555+0000","last_unstale":"2026-02-13T03:45:25.347635+0000","last_undegraded":"2026-02-13T03:45:25.347635+0000","last_fullsized":"2026-02-13T03:45:25.347635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:25.329082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186328+0000","last_change":"2026-02-13T03:45:24.349557+0000","last_active":"2026-02-13T03:45:26.186328+0000","last_peered":"2026-02-13T03:45:26.186328+0000","last_clean":"2026-02-13T03:45:26.186328+0000","last_became_active":"2026-02-13T03:45:24.349043+0000","last_became_peered":"2026-02-13T03:45:24.349043+0000","last_unstale":"2026-02-13T03:45:26.186328+0000","last_undegraded":"2026-02-13T03:45:26.186328+0000","last_fullsized":"2026-02-13T03:45:26.186328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:43.058296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636182+0000","last_change":"2026-02-13T03:45:24.349552+0000","last_active":"2026-02-13T03:45:25.636182+0000","last_peered":"2026-02-13T03:45:25.636182+0000","last_clean":"2026-02-13T03:45:25.636182+0000","last_became_active":"2026-02-13T03:45:24.349020+0000","last_became_peered":"2026-02-13T03:45:24.349020+0000","last_unstale":"2026-02-13T03:45:25.636182+0000","last_undegraded":"2026-02-13T03:45:25.636182+0000","last_fullsized":"2026-02-13T03:45:25.636182+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:11:20.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.185956+0000","last_change":"2026-02-13T03:45:24.354554+0000","last_active":"2026-02-13T03:45:26.185956+0000","last_peered":"2026-02-13T03:45:26.185956+0000","last_clean":"2026-02-13T03:45:26.185956+0000","last_became_active":"2026-02-13T03:45:24.353925+0000","last_became_peered":"2026-02-13T03:45:24.353925+0000","last_unstale":"2026-02-13T03:45:26.185956+0000","last_undegraded":"2026-02-13T03:45:26.185956+0000","last_fullsized":"2026-02-13T03:45:26.185956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:30:45.125643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186026+0000","last_change":"2026-02-13T03:45:24.355744+0000","last_active":"2026-02-13T03:45:26.186026+0000","last_peered":"2026-02-13T03:45:26.186026+0000","last_clean":"2026-02-13T03:45:26.186026+0000","last_became_active":"2026-02-13T03:45:24.355532+0000","last_became_peered":"2026-02-13T03:45:24.355532+0000","last_unstale":"2026-02-13T03:45:26.186026+0000","last_undegraded":"2026-02-13T03:45:26.186026+0000","last_fullsized":"2026-02-13T03:45:26.186026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:35:14.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347444+0000","last_change":"2026-02-13T03:45:24.355681+0000","last_active":"2026-02-13T03:45:25.347444+0000","last_peered":"2026-02-13T03:45:25.347444+0000","last_clean":"2026-02-13T03:45:25.347444+0000","last_became_active":"2026-02-13T03:45:24.355539+0000","last_became_peered":"2026-02-13T03:45:24.355539+0000","last_unstale":"2026-02-13T03:45:25.347444+0000","last_undegraded":"2026-02-13T03:45:25.347444+0000","last_fullsized":"2026-02-13T03:45:25.347444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:14:16.800666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927954+0000","last_change":"2026-02-13T03:45:24.353034+0000","last_active":"2026-02-13T03:45:25.927954+0000","last_peered":"2026-02-13T03:45:25.927954+0000","last_clean":"2026-02-13T03:45:25.927954+0000","last_became_active":"2026-02-13T03:45:24.352925+0000","last_became_peered":"2026-02-13T03:45:24.352925+0000","last_unstale":"2026-02-13T03:45:25.927954+0000","last_undegraded":"2026-02-13T03:45:25.927954+0000","last_fullsized":"2026-02-13T03:45:25.927954+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:29:42.354130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791049+0000","last_change":"2026-02-13T03:45:23.349400+0000","last_active":"2026-02-13T03:45:25.791049+0000","last_peered":"2026-02-13T03:45:25.791049+0000","last_clean":"2026-02-13T03:45:25.791049+0000","last_became_active":"2026-02-13T03:45:23.349283+0000","last_became_peered":"2026-02-13T03:45:23.349283+0000","last_unstale":"2026-02-13T03:45:25.791049+0000","last_undegraded":"2026-02-13T03:45:25.791049+0000","last_fullsized":"2026-02-13T03:45:25.791049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:43:46.907002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791094+0000","last_change":"2026-02-13T03:45:24.354044+0000","last_active":"2026-02-13T03:45:25.791094+0000","last_peered":"2026-02-13T03:45:25.791094+0000","last_clean":"2026-02-13T03:45:25.791094+0000","last_became_active":"2026-02-13T03:45:24.353314+0000","last_became_peered":"2026-02-13T03:45:24.353314+0000","last_unstale":"2026-02-13T03:45:25.791094+0000","last_undegraded":"2026-02-13T03:45:25.791094+0000","last_fullsized":"2026-02-13T03:45:25.791094+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:21:37.422406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186240+0000","last_change":"2026-02-13T03:45:23.349077+0000","last_active":"2026-02-13T03:45:26.186240+0000","last_peered":"2026-02-13T03:45:26.186240+0000","last_clean":"2026-02-13T03:45:26.186240+0000","last_became_active":"2026-02-13T03:45:23.348867+0000","last_became_peered":"2026-02-13T03:45:23.348867+0000","last_unstale":"2026-02-13T03:45:26.186240+0000","last_undegraded":"2026-02-13T03:45:26.186240+0000","last_fullsized":"2026-02-13T03:45:26.186240+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:47:13.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186082+0000","last_change":"2026-02-13T03:45:23.350107+0000","last_active":"2026-02-13T03:45:26.186082+0000","last_peered":"2026-02-13T03:45:26.186082+0000","last_clean":"2026-02-13T03:45:26.186082+0000","last_became_active":"2026-02-13T03:45:23.349864+0000","last_became_peered":"2026-02-13T03:45:23.349864+0000","last_unstale":"2026-02-13T03:45:26.186082+0000","last_undegraded":"2026-02-13T03:45:26.186082+0000","last_fullsized":"2026-02-13T03:45:26.186082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:12:31.503069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850113+0000","last_change":"2026-02-13T03:45:24.353268+0000","last_active":"2026-02-13T03:45:25.850113+0000","last_peered":"2026-02-13T03:45:25.850113+0000","last_clean":"2026-02-13T03:45:25.850113+0000","last_became_active":"2026-02-13T03:45:24.352994+0000","last_became_peered":"2026-02-13T03:45:24.352994+0000","last_unstale":"2026-02-13T03:45:25.850113+0000","last_undegraded":"2026-02-13T03:45:25.850113+0000","last_fullsized":"2026-02-13T03:45:25.850113+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:34.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791178+0000","last_change":"2026-02-13T03:45:23.348540+0000","last_active":"2026-02-13T03:45:25.791178+0000","last_peered":"2026-02-13T03:45:25.791178+0000","last_clean":"2026-02-13T03:45:25.791178+0000","last_became_active":"2026-02-13T03:45:23.348169+0000","last_became_peered":"2026-02-13T03:45:23.348169+0000","last_unstale":"2026-02-13T03:45:25.791178+0000","last_undegraded":"2026-02-13T03:45:25.791178+0000","last_fullsized":"2026-02-13T03:45:25.791178+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:41:37.655572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347232+0000","last_change":"2026-02-13T03:45:24.354464+0000","last_active":"2026-02-13T03:45:25.347232+0000","last_peered":"2026-02-13T03:45:25.347232+0000","last_clean":"2026-02-13T03:45:25.347232+0000","last_became_active":"2026-02-13T03:45:24.354209+0000","last_became_peered":"2026-02-13T03:45:24.354209+0000","last_unstale":"2026-02-13T03:45:25.347232+0000","last_undegraded":"2026-02-13T03:45:25.347232+0000","last_fullsized":"2026-02-13T03:45:25.347232+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:45:06.054136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186496+0000","last_change":"2026-02-13T03:45:23.349686+0000","last_active":"2026-02-13T03:45:26.186496+0000","last_peered":"2026-02-13T03:45:26.186496+0000","last_clean":"2026-02-13T03:45:26.186496+0000","last_became_active":"2026-02-13T03:45:23.349198+0000","last_became_peered":"2026-02-13T03:45:23.349198+0000","last_unstale":"2026-02-13T03:45:26.186496+0000","last_undegraded":"2026-02-13T03:45:26.186496+0000","last_fullsized":"2026-02-13T03:45:26.186496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:57:46.527371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170290+0000","last_change":"2026-02-13T03:45:24.355581+0000","last_active":"2026-02-13T03:45:26.170290+0000","last_peered":"2026-02-13T03:45:26.170290+0000","last_clean":"2026-02-13T03:45:26.170290+0000","last_became_active":"2026-02-13T03:45:24.355429+0000","last_became_peered":"2026-02-13T03:45:24.355429+0000","last_unstale":"2026-02-13T03:45:26.170290+0000","last_undegraded":"2026-02-13T03:45:26.170290+0000","last_fullsized":"2026-02-13T03:45:26.170290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:49:00.947016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421822+0000","last_change":"2026-02-13T03:45:23.350353+0000","last_active":"2026-02-13T03:45:25.421822+0000","last_peered":"2026-02-13T03:45:25.421822+0000","last_clean":"2026-02-13T03:45:25.421822+0000","last_became_active":"2026-02-13T03:45:23.349728+0000","last_became_peered":"2026-02-13T03:45:23.349728+0000","last_unstale":"2026-02-13T03:45:25.421822+0000","last_undegraded":"2026-02-13T03:45:25.421822+0000","last_fullsized":"2026-02-13T03:45:25.421822+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:21:58.252825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636487+0000","last_change":"2026-02-13T03:45:24.355069+0000","last_active":"2026-02-13T03:45:25.636487+0000","last_peered":"2026-02-13T03:45:25.636487+0000","last_clean":"2026-02-13T03:45:25.636487+0000","last_became_active":"2026-02-13T03:45:24.354927+0000","last_became_peered":"2026-02-13T03:45:24.354927+0000","last_unstale":"2026-02-13T03:45:25.636487+0000","last_undegraded":"2026-02-13T03:45:25.636487+0000","last_fullsized":"2026-02-13T03:45:25.636487+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:55:26.835770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"69'3","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791069+0000","last_change":"2026-02-13T03:45:23.352479+0000","last_active":"2026-02-13T03:45:25.791069+0000","last_peered":"2026-02-13T03:45:25.791069+0000","last_clean":"2026-02-13T03:45:25.791069+0000","last_became_active":"2026-02-13T03:45:23.352227+0000","last_became_peered":"2026-02-13T03:45:23.352227+0000","last_unstale":"2026-02-13T03:45:25.791069+0000","last_undegraded":"2026-02-13T03:45:25.791069+0000","last_fullsized":"2026-02-13T03:45:25.791069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:24:25.395518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170237+0000","last_change":"2026-02-13T03:45:24.353602+0000","last_active":"2026-02-13T03:45:26.170237+0000","last_peered":"2026-02-13T03:45:26.170237+0000","last_clean":"2026-02-13T03:45:26.170237+0000","last_became_active":"2026-02-13T03:45:24.352872+0000","last_became_peered":"2026-02-13T03:45:24.352872+0000","last_unstale":"2026-02-13T03:45:26.170237+0000","last_undegraded":"2026-02-13T03:45:26.170237+0000","last_fullsized":"2026-02-13T03:45:26.170237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:38.831095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"70'21","reported_seq":58,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:33.921479+0000","last_change":"2026-02-13T03:45:23.349666+0000","last_active":"2026-02-13T03:45:33.921479+0000","last_peered":"2026-02-13T03:45:33.921479+0000","last_clean":"2026-02-13T03:45:33.921479+0000","last_became_active":"2026-02-13T03:45:23.349482+0000","last_became_peered":"2026-02-13T03:45:23.349482+0000","last_unstale":"2026-02-13T03:45:33.921479+0000","last_undegraded":"2026-02-13T03:45:33.921479+0000","last_fullsized":"2026-02-13T03:45:33.921479+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:36.983368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54004,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":63,"num_write":21,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928003+0000","last_change":"2026-02-13T03:45:24.352564+0000","last_active":"2026-02-13T03:45:25.928003+0000","last_peered":"2026-02-13T03:45:25.928003+0000","last_clean":"2026-02-13T03:45:25.928003+0000","last_became_active":"2026-02-13T03:45:24.352442+0000","last_became_peered":"2026-02-13T03:45:24.352442+0000","last_unstale":"2026-02-13T03:45:25.928003+0000","last_undegraded":"2026-02-13T03:45:25.928003+0000","last_fullsized":"2026-02-13T03:45:25.928003+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:40:35.470403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"69'2","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186086+0000","last_change":"2026-02-13T03:45:23.349943+0000","last_active":"2026-02-13T03:45:26.186086+0000","last_peered":"2026-02-13T03:45:26.186086+0000","last_clean":"2026-02-13T03:45:26.186086+0000","last_became_active":"2026-02-13T03:45:23.349747+0000","last_became_peered":"2026-02-13T03:45:23.349747+0000","last_unstale":"2026-02-13T03:45:26.186086+0000","last_undegraded":"2026-02-13T03:45:26.186086+0000","last_fullsized":"2026-02-13T03:45:26.186086+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:46:29.724224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186270+0000","last_change":"2026-02-13T03:45:24.353731+0000","last_active":"2026-02-13T03:45:26.186270+0000","last_peered":"2026-02-13T03:45:26.186270+0000","last_clean":"2026-02-13T03:45:26.186270+0000","last_became_active":"2026-02-13T03:45:24.353367+0000","last_became_peered":"2026-02-13T03:45:24.353367+0000","last_unstale":"2026-02-13T03:45:26.186270+0000","last_undegraded":"2026-02-13T03:45:26.186270+0000","last_fullsized":"2026-02-13T03:45:26.186270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:23:13.530630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.790926+0000","last_change":"2026-02-13T03:45:23.348565+0000","last_active":"2026-02-13T03:45:25.790926+0000","last_peered":"2026-02-13T03:45:25.790926+0000","last_clean":"2026-02-13T03:45:25.790926+0000","last_became_active":"2026-02-13T03:45:23.348280+0000","last_became_peered":"2026-02-13T03:45:23.348280+0000","last_unstale":"2026-02-13T03:45:25.790926+0000","last_undegraded":"2026-02-13T03:45:25.790926+0000","last_fullsized":"2026-02-13T03:45:25.790926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:55:08.236742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421805+0000","last_change":"2026-02-13T03:45:24.353067+0000","last_active":"2026-02-13T03:45:25.421805+0000","last_peered":"2026-02-13T03:45:25.421805+0000","last_clean":"2026-02-13T03:45:25.421805+0000","last_became_active":"2026-02-13T03:45:24.352535+0000","last_became_peered":"2026-02-13T03:45:24.352535+0000","last_unstale":"2026-02-13T03:45:25.421805+0000","last_undegraded":"2026-02-13T03:45:25.421805+0000","last_fullsized":"2026-02-13T03:45:25.421805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:19.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347856+0000","last_change":"2026-02-13T03:45:23.349989+0000","last_active":"2026-02-13T03:45:25.347856+0000","last_peered":"2026-02-13T03:45:25.347856+0000","last_clean":"2026-02-13T03:45:25.347856+0000","last_became_active":"2026-02-13T03:45:23.349774+0000","last_became_peered":"2026-02-13T03:45:23.349774+0000","last_unstale":"2026-02-13T03:45:25.347856+0000","last_undegraded":"2026-02-13T03:45:25.347856+0000","last_fullsized":"2026-02-13T03:45:25.347856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:10.402322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421339+0000","last_change":"2026-02-13T03:45:24.356431+0000","last_active":"2026-02-13T03:45:25.421339+0000","last_peered":"2026-02-13T03:45:25.421339+0000","last_clean":"2026-02-13T03:45:25.421339+0000","last_became_active":"2026-02-13T03:45:24.355854+0000","last_became_peered":"2026-02-13T03:45:24.355854+0000","last_unstale":"2026-02-13T03:45:25.421339+0000","last_undegraded":"2026-02-13T03:45:25.421339+0000","last_fullsized":"2026-02-13T03:45:25.421339+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:23:56.021478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"69'8","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927749+0000","last_change":"2026-02-13T03:45:23.352300+0000","last_active":"2026-02-13T03:45:25.927749+0000","last_peered":"2026-02-13T03:45:25.927749+0000","last_clean":"2026-02-13T03:45:25.927749+0000","last_became_active":"2026-02-13T03:45:23.352176+0000","last_became_peered":"2026-02-13T03:45:23.352176+0000","last_unstale":"2026-02-13T03:45:25.927749+0000","last_undegraded":"2026-02-13T03:45:25.927749+0000","last_fullsized":"2026-02-13T03:45:25.927749+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:56.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791150+0000","last_change":"2026-02-13T03:45:24.355963+0000","last_active":"2026-02-13T03:45:25.791150+0000","last_peered":"2026-02-13T03:45:25.791150+0000","last_clean":"2026-02-13T03:45:25.791150+0000","last_became_active":"2026-02-13T03:45:24.354819+0000","last_became_peered":"2026-02-13T03:45:24.354819+0000","last_unstale":"2026-02-13T03:45:25.791150+0000","last_undegraded":"2026-02-13T03:45:25.791150+0000","last_fullsized":"2026-02-13T03:45:25.791150+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:23:36.255505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"69'1","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928091+0000","last_change":"2026-02-13T03:45:23.346399+0000","last_active":"2026-02-13T03:45:25.928091+0000","last_peered":"2026-02-13T03:45:25.928091+0000","last_clean":"2026-02-13T03:45:25.928091+0000","last_became_active":"2026-02-13T03:45:23.346195+0000","last_became_peered":"2026-02-13T03:45:23.346195+0000","last_unstale":"2026-02-13T03:45:25.928091+0000","last_undegraded":"2026-02-13T03:45:25.928091+0000","last_fullsized":"2026-02-13T03:45:25.928091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:40:17.923580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347701+0000","last_change":"2026-02-13T03:45:24.355093+0000","last_active":"2026-02-13T03:45:25.347701+0000","last_peered":"2026-02-13T03:45:25.347701+0000","last_clean":"2026-02-13T03:45:25.347701+0000","last_became_active":"2026-02-13T03:45:24.354967+0000","last_became_peered":"2026-02-13T03:45:24.354967+0000","last_unstale":"2026-02-13T03:45:25.347701+0000","last_undegraded":"2026-02-13T03:45:25.347701+0000","last_fullsized":"2026-02-13T03:45:25.347701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:47.555133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186318+0000","last_change":"2026-02-13T03:45:23.350209+0000","last_active":"2026-02-13T03:45:26.186318+0000","last_peered":"2026-02-13T03:45:26.186318+0000","last_clean":"2026-02-13T03:45:26.186318+0000","last_became_active":"2026-02-13T03:45:23.349865+0000","last_became_peered":"2026-02-13T03:45:23.349865+0000","last_unstale":"2026-02-13T03:45:26.186318+0000","last_undegraded":"2026-02-13T03:45:26.186318+0000","last_fullsized":"2026-02-13T03:45:26.186318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:31:13.959587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.422025+0000","last_change":"2026-02-13T03:45:24.353947+0000","last_active":"2026-02-13T03:45:25.422025+0000","last_peered":"2026-02-13T03:45:25.422025+0000","last_clean":"2026-02-13T03:45:25.422025+0000","last_became_active":"2026-02-13T03:45:24.353550+0000","last_became_peered":"2026-02-13T03:45:24.353550+0000","last_unstale":"2026-02-13T03:45:25.422025+0000","last_undegraded":"2026-02-13T03:45:25.422025+0000","last_fullsized":"2026-02-13T03:45:25.422025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:39.579793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"69'1","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.792532+0000","last_change":"2026-02-13T03:45:23.347676+0000","last_active":"2026-02-13T03:45:26.792532+0000","last_peered":"2026-02-13T03:45:26.792532+0000","last_clean":"2026-02-13T03:45:26.792532+0000","last_became_active":"2026-02-13T03:45:23.347440+0000","last_became_peered":"2026-02-13T03:45:23.347440+0000","last_unstale":"2026-02-13T03:45:26.792532+0000","last_undegraded":"2026-02-13T03:45:26.792532+0000","last_fullsized":"2026-02-13T03:45:26.792532+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:57:40.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.420064+0000","last_change":"2026-02-13T03:45:24.356079+0000","last_active":"2026-02-13T03:45:26.420064+0000","last_peered":"2026-02-13T03:45:26.420064+0000","last_clean":"2026-02-13T03:45:26.420064+0000","last_became_active":"2026-02-13T03:45:24.355776+0000","last_became_peered":"2026-02-13T03:45:24.355776+0000","last_unstale":"2026-02-13T03:45:26.420064+0000","last_undegraded":"2026-02-13T03:45:26.420064+0000","last_fullsized":"2026-02-13T03:45:26.420064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:06.447768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186148+0000","last_change":"2026-02-13T03:45:23.352633+0000","last_active":"2026-02-13T03:45:26.186148+0000","last_peered":"2026-02-13T03:45:26.186148+0000","last_clean":"2026-02-13T03:45:26.186148+0000","last_became_active":"2026-02-13T03:45:23.352460+0000","last_became_peered":"2026-02-13T03:45:23.352460+0000","last_unstale":"2026-02-13T03:45:26.186148+0000","last_undegraded":"2026-02-13T03:45:26.186148+0000","last_fullsized":"2026-02-13T03:45:26.186148+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:59.397129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.422048+0000","last_change":"2026-02-13T03:45:24.353603+0000","last_active":"2026-02-13T03:45:25.422048+0000","last_peered":"2026-02-13T03:45:25.422048+0000","last_clean":"2026-02-13T03:45:25.422048+0000","last_became_active":"2026-02-13T03:45:24.353292+0000","last_became_peered":"2026-02-13T03:45:24.353292+0000","last_unstale":"2026-02-13T03:45:25.422048+0000","last_undegraded":"2026-02-13T03:45:25.422048+0000","last_fullsized":"2026-02-13T03:45:25.422048+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:04:30.019967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'152","reported_seq":336,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421413+0000","last_change":"2026-02-13T03:45:01.868042+0000","last_active":"2026-02-13T03:45:25.421413+0000","last_peered":"2026-02-13T03:45:25.421413+0000","last_clean":"2026-02-13T03:45:25.421413+0000","last_became_active":"2026-02-13T03:45:01.867747+0000","last_became_peered":"2026-02-13T03:45:01.867747+0000","last_unstale":"2026-02-13T03:45:25.421413+0000","last_undegraded":"2026-02-13T03:45:25.421413+0000","last_fullsized":"2026-02-13T03:45:25.421413+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:43:59.641267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:43:59.641267+0000","last_clean_scrub_stamp":"2026-02-13T03:43:59.641267+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:48:43.238019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347838+0000","last_change":"2026-02-13T03:45:23.349113+0000","last_active":"2026-02-13T03:45:25.347838+0000","last_peered":"2026-02-13T03:45:25.347838+0000","last_clean":"2026-02-13T03:45:25.347838+0000","last_became_active":"2026-02-13T03:45:23.348948+0000","last_became_peered":"2026-02-13T03:45:23.348948+0000","last_unstale":"2026-02-13T03:45:25.347838+0000","last_undegraded":"2026-02-13T03:45:25.347838+0000","last_fullsized":"2026-02-13T03:45:25.347838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:00:41.357000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850169+0000","last_change":"2026-02-13T03:45:24.354838+0000","last_active":"2026-02-13T03:45:25.850169+0000","last_peered":"2026-02-13T03:45:25.850169+0000","last_clean":"2026-02-13T03:45:25.850169+0000","last_became_active":"2026-02-13T03:45:24.354639+0000","last_became_peered":"2026-02-13T03:45:24.354639+0000","last_unstale":"2026-02-13T03:45:25.850169+0000","last_undegraded":"2026-02-13T03:45:25.850169+0000","last_fullsized":"2026-02-13T03:45:25.850169+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:22.121456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421381+0000","last_change":"2026-02-13T03:45:23.349837+0000","last_active":"2026-02-13T03:45:25.421381+0000","last_peered":"2026-02-13T03:45:25.421381+0000","last_clean":"2026-02-13T03:45:25.421381+0000","last_became_active":"2026-02-13T03:45:23.349223+0000","last_became_peered":"2026-02-13T03:45:23.349223+0000","last_unstale":"2026-02-13T03:45:25.421381+0000","last_undegraded":"2026-02-13T03:45:25.421381+0000","last_fullsized":"2026-02-13T03:45:25.421381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:38:18.742824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186170+0000","last_change":"2026-02-13T03:45:24.349832+0000","last_active":"2026-02-13T03:45:26.186170+0000","last_peered":"2026-02-13T03:45:26.186170+0000","last_clean":"2026-02-13T03:45:26.186170+0000","last_became_active":"2026-02-13T03:45:24.349608+0000","last_became_peered":"2026-02-13T03:45:24.349608+0000","last_unstale":"2026-02-13T03:45:26.186170+0000","last_undegraded":"2026-02-13T03:45:26.186170+0000","last_fullsized":"2026-02-13T03:45:26.186170+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:45:53.372675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186175+0000","last_change":"2026-02-13T03:45:23.352560+0000","last_active":"2026-02-13T03:45:26.186175+0000","last_peered":"2026-02-13T03:45:26.186175+0000","last_clean":"2026-02-13T03:45:26.186175+0000","last_became_active":"2026-02-13T03:45:23.352373+0000","last_became_peered":"2026-02-13T03:45:23.352373+0000","last_unstale":"2026-02-13T03:45:26.186175+0000","last_undegraded":"2026-02-13T03:45:26.186175+0000","last_fullsized":"2026-02-13T03:45:26.186175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:13:31.193029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791006+0000","last_change":"2026-02-13T03:45:24.354558+0000","last_active":"2026-02-13T03:45:25.791006+0000","last_peered":"2026-02-13T03:45:25.791006+0000","last_clean":"2026-02-13T03:45:25.791006+0000","last_became_active":"2026-02-13T03:45:24.354213+0000","last_became_peered":"2026-02-13T03:45:24.354213+0000","last_unstale":"2026-02-13T03:45:25.791006+0000","last_undegraded":"2026-02-13T03:45:25.791006+0000","last_fullsized":"2026-02-13T03:45:25.791006+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:21.319355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421761+0000","last_change":"2026-02-13T03:45:23.350556+0000","last_active":"2026-02-13T03:45:25.421761+0000","last_peered":"2026-02-13T03:45:25.421761+0000","last_clean":"2026-02-13T03:45:25.421761+0000","last_became_active":"2026-02-13T03:45:23.349778+0000","last_became_peered":"2026-02-13T03:45:23.349778+0000","last_unstale":"2026-02-13T03:45:25.421761+0000","last_undegraded":"2026-02-13T03:45:25.421761+0000","last_fullsized":"2026-02-13T03:45:25.421761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:30:14.999945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186456+0000","last_change":"2026-02-13T03:45:24.356662+0000","last_active":"2026-02-13T03:45:26.186456+0000","last_peered":"2026-02-13T03:45:26.186456+0000","last_clean":"2026-02-13T03:45:26.186456+0000","last_became_active":"2026-02-13T03:45:24.356145+0000","last_became_peered":"2026-02-13T03:45:24.356145+0000","last_unstale":"2026-02-13T03:45:26.186456+0000","last_undegraded":"2026-02-13T03:45:26.186456+0000","last_fullsized":"2026-02-13T03:45:26.186456+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:52.281060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347168+0000","last_change":"2026-02-13T03:45:23.351917+0000","last_active":"2026-02-13T03:45:25.347168+0000","last_peered":"2026-02-13T03:45:25.347168+0000","last_clean":"2026-02-13T03:45:25.347168+0000","last_became_active":"2026-02-13T03:45:23.351794+0000","last_became_peered":"2026-02-13T03:45:23.351794+0000","last_unstale":"2026-02-13T03:45:25.347168+0000","last_undegraded":"2026-02-13T03:45:25.347168+0000","last_fullsized":"2026-02-13T03:45:25.347168+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:15.488304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186500+0000","last_change":"2026-02-13T03:45:24.352772+0000","last_active":"2026-02-13T03:45:26.186500+0000","last_peered":"2026-02-13T03:45:26.186500+0000","last_clean":"2026-02-13T03:45:26.186500+0000","last_became_active":"2026-02-13T03:45:24.352569+0000","last_became_peered":"2026-02-13T03:45:24.352569+0000","last_unstale":"2026-02-13T03:45:26.186500+0000","last_undegraded":"2026-02-13T03:45:26.186500+0000","last_fullsized":"2026-02-13T03:45:26.186500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:33:13.188588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928147+0000","last_change":"2026-02-13T03:45:23.352357+0000","last_active":"2026-02-13T03:45:25.928147+0000","last_peered":"2026-02-13T03:45:25.928147+0000","last_clean":"2026-02-13T03:45:25.928147+0000","last_became_active":"2026-02-13T03:45:23.352192+0000","last_became_peered":"2026-02-13T03:45:23.352192+0000","last_unstale":"2026-02-13T03:45:25.928147+0000","last_undegraded":"2026-02-13T03:45:25.928147+0000","last_fullsized":"2026-02-13T03:45:25.928147+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:07:52.352111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186361+0000","last_change":"2026-02-13T03:45:24.351804+0000","last_active":"2026-02-13T03:45:26.186361+0000","last_peered":"2026-02-13T03:45:26.186361+0000","last_clean":"2026-02-13T03:45:26.186361+0000","last_became_active":"2026-02-13T03:45:24.351594+0000","last_became_peered":"2026-02-13T03:45:24.351594+0000","last_unstale":"2026-02-13T03:45:26.186361+0000","last_undegraded":"2026-02-13T03:45:26.186361+0000","last_fullsized":"2026-02-13T03:45:26.186361+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:26:57.857287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"70'4","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:29.354554+0000","last_change":"2026-02-13T03:45:23.350776+0000","last_active":"2026-02-13T03:45:29.354554+0000","last_peered":"2026-02-13T03:45:29.354554+0000","last_clean":"2026-02-13T03:45:29.354554+0000","last_became_active":"2026-02-13T03:45:23.350640+0000","last_became_peered":"2026-02-13T03:45:23.350640+0000","last_unstale":"2026-02-13T03:45:29.354554+0000","last_undegraded":"2026-02-13T03:45:29.354554+0000","last_fullsized":"2026-02-13T03:45:29.354554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:52:28.690330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850321+0000","last_change":"2026-02-13T03:45:24.353462+0000","last_active":"2026-02-13T03:45:25.850321+0000","last_peered":"2026-02-13T03:45:25.850321+0000","last_clean":"2026-02-13T03:45:25.850321+0000","last_became_active":"2026-02-13T03:45:24.353125+0000","last_became_peered":"2026-02-13T03:45:24.353125+0000","last_unstale":"2026-02-13T03:45:25.850321+0000","last_undegraded":"2026-02-13T03:45:25.850321+0000","last_fullsized":"2026-02-13T03:45:25.850321+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:28:11.227093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348198+0000","last_change":"2026-02-13T03:45:23.354142+0000","last_active":"2026-02-13T03:45:25.348198+0000","last_peered":"2026-02-13T03:45:25.348198+0000","last_clean":"2026-02-13T03:45:25.348198+0000","last_became_active":"2026-02-13T03:45:23.353998+0000","last_became_peered":"2026-02-13T03:45:23.353998+0000","last_unstale":"2026-02-13T03:45:25.348198+0000","last_undegraded":"2026-02-13T03:45:25.348198+0000","last_fullsized":"2026-02-13T03:45:25.348198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:38:02.155173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636264+0000","last_change":"2026-02-13T03:45:24.352663+0000","last_active":"2026-02-13T03:45:25.636264+0000","last_peered":"2026-02-13T03:45:25.636264+0000","last_clean":"2026-02-13T03:45:25.636264+0000","last_became_active":"2026-02-13T03:45:24.352121+0000","last_became_peered":"2026-02-13T03:45:24.352121+0000","last_unstale":"2026-02-13T03:45:25.636264+0000","last_undegraded":"2026-02-13T03:45:25.636264+0000","last_fullsized":"2026-02-13T03:45:25.636264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:53:59.157080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170156+0000","last_change":"2026-02-13T03:45:23.352681+0000","last_active":"2026-02-13T03:45:26.170156+0000","last_peered":"2026-02-13T03:45:26.170156+0000","last_clean":"2026-02-13T03:45:26.170156+0000","last_became_active":"2026-02-13T03:45:23.352549+0000","last_became_peered":"2026-02-13T03:45:23.352549+0000","last_unstale":"2026-02-13T03:45:26.170156+0000","last_undegraded":"2026-02-13T03:45:26.170156+0000","last_fullsized":"2026-02-13T03:45:26.170156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:19:36.419406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927843+0000","last_change":"2026-02-13T03:45:24.353993+0000","last_active":"2026-02-13T03:45:25.927843+0000","last_peered":"2026-02-13T03:45:25.927843+0000","last_clean":"2026-02-13T03:45:25.927843+0000","last_became_active":"2026-02-13T03:45:24.353849+0000","last_became_peered":"2026-02-13T03:45:24.353849+0000","last_unstale":"2026-02-13T03:45:25.927843+0000","last_undegraded":"2026-02-13T03:45:25.927843+0000","last_fullsized":"2026-02-13T03:45:25.927843+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:37:28.284522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850035+0000","last_change":"2026-02-13T03:45:23.350245+0000","last_active":"2026-02-13T03:45:25.850035+0000","last_peered":"2026-02-13T03:45:25.850035+0000","last_clean":"2026-02-13T03:45:25.850035+0000","last_became_active":"2026-02-13T03:45:23.349993+0000","last_became_peered":"2026-02-13T03:45:23.349993+0000","last_unstale":"2026-02-13T03:45:25.850035+0000","last_undegraded":"2026-02-13T03:45:25.850035+0000","last_fullsized":"2026-02-13T03:45:25.850035+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:26.787163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347702+0000","last_change":"2026-02-13T03:45:24.357857+0000","last_active":"2026-02-13T03:45:25.347702+0000","last_peered":"2026-02-13T03:45:25.347702+0000","last_clean":"2026-02-13T03:45:25.347702+0000","last_became_active":"2026-02-13T03:45:24.357686+0000","last_became_peered":"2026-02-13T03:45:24.357686+0000","last_unstale":"2026-02-13T03:45:25.347702+0000","last_undegraded":"2026-02-13T03:45:25.347702+0000","last_fullsized":"2026-02-13T03:45:25.347702+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:18:49.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.185913+0000","last_change":"2026-02-13T03:45:23.349986+0000","last_active":"2026-02-13T03:45:26.185913+0000","last_peered":"2026-02-13T03:45:26.185913+0000","last_clean":"2026-02-13T03:45:26.185913+0000","last_became_active":"2026-02-13T03:45:23.349724+0000","last_became_peered":"2026-02-13T03:45:23.349724+0000","last_unstale":"2026-02-13T03:45:26.185913+0000","last_undegraded":"2026-02-13T03:45:26.185913+0000","last_fullsized":"2026-02-13T03:45:26.185913+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:17:32.924039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850162+0000","last_change":"2026-02-13T03:45:24.354082+0000","last_active":"2026-02-13T03:45:25.850162+0000","last_peered":"2026-02-13T03:45:25.850162+0000","last_clean":"2026-02-13T03:45:25.850162+0000","last_became_active":"2026-02-13T03:45:24.353693+0000","last_became_peered":"2026-02-13T03:45:24.353693+0000","last_unstale":"2026-02-13T03:45:25.850162+0000","last_undegraded":"2026-02-13T03:45:25.850162+0000","last_fullsized":"2026-02-13T03:45:25.850162+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:56.149445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"69'2","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927928+0000","last_change":"2026-02-13T03:45:23.349449+0000","last_active":"2026-02-13T03:45:25.927928+0000","last_peered":"2026-02-13T03:45:25.927928+0000","last_clean":"2026-02-13T03:45:25.927928+0000","last_became_active":"2026-02-13T03:45:23.349088+0000","last_became_peered":"2026-02-13T03:45:23.349088+0000","last_unstale":"2026-02-13T03:45:25.927928+0000","last_undegraded":"2026-02-13T03:45:25.927928+0000","last_fullsized":"2026-02-13T03:45:25.927928+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:47:08.987853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421786+0000","last_change":"2026-02-13T03:45:24.353460+0000","last_active":"2026-02-13T03:45:25.421786+0000","last_peered":"2026-02-13T03:45:25.421786+0000","last_clean":"2026-02-13T03:45:25.421786+0000","last_became_active":"2026-02-13T03:45:24.353234+0000","last_became_peered":"2026-02-13T03:45:24.353234+0000","last_unstale":"2026-02-13T03:45:25.421786+0000","last_undegraded":"2026-02-13T03:45:25.421786+0000","last_fullsized":"2026-02-13T03:45:25.421786+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:37.604254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791188+0000","last_change":"2026-02-13T03:45:24.356273+0000","last_active":"2026-02-13T03:45:25.791188+0000","last_peered":"2026-02-13T03:45:25.791188+0000","last_clean":"2026-02-13T03:45:25.791188+0000","last_became_active":"2026-02-13T03:45:24.355811+0000","last_became_peered":"2026-02-13T03:45:24.355811+0000","last_unstale":"2026-02-13T03:45:25.791188+0000","last_undegraded":"2026-02-13T03:45:25.791188+0000","last_fullsized":"2026-02-13T03:45:25.791188+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:16:38.126683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928123+0000","last_change":"2026-02-13T03:45:23.348661+0000","last_active":"2026-02-13T03:45:25.928123+0000","last_peered":"2026-02-13T03:45:25.928123+0000","last_clean":"2026-02-13T03:45:25.928123+0000","last_became_active":"2026-02-13T03:45:23.348261+0000","last_became_peered":"2026-02-13T03:45:23.348261+0000","last_unstale":"2026-02-13T03:45:25.928123+0000","last_undegraded":"2026-02-13T03:45:25.928123+0000","last_fullsized":"2026-02-13T03:45:25.928123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:55.257025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170184+0000","last_change":"2026-02-13T03:45:24.354121+0000","last_active":"2026-02-13T03:45:26.170184+0000","last_peered":"2026-02-13T03:45:26.170184+0000","last_clean":"2026-02-13T03:45:26.170184+0000","last_became_active":"2026-02-13T03:45:24.354004+0000","last_became_peered":"2026-02-13T03:45:24.354004+0000","last_unstale":"2026-02-13T03:45:26.170184+0000","last_undegraded":"2026-02-13T03:45:26.170184+0000","last_fullsized":"2026-02-13T03:45:26.170184+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:23:50.879001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928021+0000","last_change":"2026-02-13T03:45:23.348978+0000","last_active":"2026-02-13T03:45:25.928021+0000","last_peered":"2026-02-13T03:45:25.928021+0000","last_clean":"2026-02-13T03:45:25.928021+0000","last_became_active":"2026-02-13T03:45:23.348824+0000","last_became_peered":"2026-02-13T03:45:23.348824+0000","last_unstale":"2026-02-13T03:45:25.928021+0000","last_undegraded":"2026-02-13T03:45:25.928021+0000","last_fullsized":"2026-02-13T03:45:25.928021+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:46:48.932535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636503+0000","last_change":"2026-02-13T03:45:24.354516+0000","last_active":"2026-02-13T03:45:25.636503+0000","last_peered":"2026-02-13T03:45:25.636503+0000","last_clean":"2026-02-13T03:45:25.636503+0000","last_became_active":"2026-02-13T03:45:24.353042+0000","last_became_peered":"2026-02-13T03:45:24.353042+0000","last_unstale":"2026-02-13T03:45:25.636503+0000","last_undegraded":"2026-02-13T03:45:25.636503+0000","last_fullsized":"2026-02-13T03:45:25.636503+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:34:41.644225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850303+0000","last_change":"2026-02-13T03:45:23.353085+0000","last_active":"2026-02-13T03:45:25.850303+0000","last_peered":"2026-02-13T03:45:25.850303+0000","last_clean":"2026-02-13T03:45:25.850303+0000","last_became_active":"2026-02-13T03:45:23.352945+0000","last_became_peered":"2026-02-13T03:45:23.352945+0000","last_unstale":"2026-02-13T03:45:25.850303+0000","last_undegraded":"2026-02-13T03:45:25.850303+0000","last_fullsized":"2026-02-13T03:45:25.850303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:59.326051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850314+0000","last_change":"2026-02-13T03:45:24.356661+0000","last_active":"2026-02-13T03:45:25.850314+0000","last_peered":"2026-02-13T03:45:25.850314+0000","last_clean":"2026-02-13T03:45:25.850314+0000","last_became_active":"2026-02-13T03:45:24.356440+0000","last_became_peered":"2026-02-13T03:45:24.356440+0000","last_unstale":"2026-02-13T03:45:25.850314+0000","last_undegraded":"2026-02-13T03:45:25.850314+0000","last_fullsized":"2026-02-13T03:45:25.850314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:20.190644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"69'4","reported_seq":21,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.281389+0000","last_change":"2026-02-13T03:45:23.349442+0000","last_active":"2026-02-13T03:45:26.281389+0000","last_peered":"2026-02-13T03:45:26.281389+0000","last_clean":"2026-02-13T03:45:26.281389+0000","last_became_active":"2026-02-13T03:45:23.349265+0000","last_became_peered":"2026-02-13T03:45:23.349265+0000","last_unstale":"2026-02-13T03:45:26.281389+0000","last_undegraded":"2026-02-13T03:45:26.281389+0000","last_fullsized":"2026-02-13T03:45:26.281389+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:08:11.896196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54824,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":27,"num_read_kb":69,"num_write":66,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":164472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62969,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":299612,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874249,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":365060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8466,"internal_metadata":27582190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":58,"seq":249108103178,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27832,"kb_used_data":868,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975368,"statfs":{"total":751619276800,"available":751590776832,"internally_reserved":0,"allocated":888832,"data_stored":1009743,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":18705,"internal_metadata":27571951},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928233995,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":16,"kb_used_meta":26927,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17162,"internal_metadata":27573494},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27712,"kb_used_data":748,"kb_used_omap":22,"kb_used_meta":26922,"kb_avail":733975488,"statfs":{"total":751619276800,"available":751590899712,"internally_reserved":0,"allocated":765952,"data_stored":365686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22528,"internal_metadata":27568128},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":40,"seq":171798691853,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":956149,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23850,"internal_metadata":27566806},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":36,"seq":154618822672,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19432,"internal_metadata":27571224},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":29,"seq":124554051601,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":955727,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":12636,"internal_metadata":27578020},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":26,"seq":111669149714,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30605,"internal_metadata":27560051},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378644,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27720,"kb_used_data":756,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975480,"statfs":{"total":751619276800,"available":751590891520,"internally_reserved":0,"allocated":774144,"data_stored":365398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33966,"internal_metadata":27556690},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":419098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49132,"internal_metadata":27541524},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672982,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":419064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40057,"internal_metadata":27550599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771097,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40414,"internal_metadata":27550242},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3730,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":54038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8260,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17446,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8820,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2208,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":778,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1892,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":54198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10968,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3420,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T03:45:36.670 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T03:45:36.819 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:36.947 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 -- 10.20.193.70:0/2089371708 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410fc20 msgr2=0x7f2974114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.947 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 --2- 10.20.193.70:0/2089371708 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410fc20 0x7f2974114c60 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=9360445725900536440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29680099a0 tx=0x7f296802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 -- 10.20.193.70:0/2089371708 shutdown_connections 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 --2- 10.20.193.70:0/2089371708 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2974115440 0x7f2974175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 --2- 10.20.193.70:0/2089371708 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410fc20 0x7f2974114c60 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=9360445725900536440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 --2- 10.20.193.70:0/2089371708 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f297410f230 0x7f297410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 -- 10.20.193.70:0/2089371708 >> 10.20.193.70:0/2089371708 conn(0x7f29740ecb30 msgr2=0x7f297410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 -- 10.20.193.70:0/2089371708 shutdown_connections 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 -- 10.20.193.70:0/2089371708 wait complete. 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 Processor -- start 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 -- start start 2026-02-13T03:45:36.948 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410f230 0x7f29740f4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2974115440 0x7f2974175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29740f5330 0x7f29740fa5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29740f5a20 con 0x7f297410f230 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f29740faaf0 con 0x7f2974115440 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f297bf006c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f29740facb0 con 0x7f29740f5330 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f2979c756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410f230 0x7f29740f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f2979c756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410f230 0x7f29740f4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:39922/0 (socket says 10.20.193.70:39922) 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f2979c756c0 1 -- 10.20.193.70:0/64536979 learned_addr learned my addr 10.20.193.70:0/64536979 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.943+0000 7f29794746c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2974115440 0x7f2974175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f297a4766c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29740f5330 0x7f29740fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.949 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f2979c756c0 1 -- 10.20.193.70:0/64536979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29740f5330 msgr2=0x7f29740fa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f2979c756c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29740f5330 0x7f29740fa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f2979c756c0 1 -- 10.20.193.70:0/64536979 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2974115440 msgr2=0x7f2974175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f2979c756c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2974115440 0x7f2974175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f2979c756c0 1 -- 10.20.193.70:0/64536979 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2968009590 con 0x7f297410f230 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f297a4766c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29740f5330 0x7f29740fa5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f29794746c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2974115440 0x7f2974175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f2979c756c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410f230 0x7f29740f4d00 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f296400b710 tx=0x7f296400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f2962ffd6c0 1 -- 10.20.193.70:0/64536979 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2964004250 con 0x7f297410f230 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f2962ffd6c0 1 -- 10.20.193.70:0/64536979 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2964009070 con 0x7f297410f230 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29740faf90 con 0x7f297410f230 2026-02-13T03:45:36.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f2962ffd6c0 1 -- 10.20.193.70:0/64536979 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f296400ccd0 con 0x7f297410f230 2026-02-13T03:45:36.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29740fb720 con 0x7f297410f230 2026-02-13T03:45:36.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.944+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2974110500 con 0x7f297410f230 2026-02-13T03:45:36.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.945+0000 7f2962ffd6c0 1 -- 10.20.193.70:0/64536979 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f29640028c0 con 0x7f297410f230 2026-02-13T03:45:36.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.946+0000 7f2962ffd6c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29500b5710 0x7f29500d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:36.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.946+0000 7f29794746c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29500b5710 0x7f29500d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:36.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.946+0000 7f2962ffd6c0 1 -- 10.20.193.70:0/64536979 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f29640e3c20 con 0x7f297410f230 2026-02-13T03:45:36.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.946+0000 7f29794746c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29500b5710 0x7f29500d5bc0 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29680023e0 tx=0x7f2968005b00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:36.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:36.947+0000 7f2962ffd6c0 1 -- 10.20.193.70:0/64536979 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f29640a6640 con 0x7f297410f230 2026-02-13T03:45:37.040 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.037+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 --> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29740f5e30 con 0x7f29500b5710 2026-02-13T03:45:37.040 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: pgmap v192: 97 pgs: 97 active+clean; 630 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 7.3 KiB/s wr, 8 op/s 2026-02-13T03:45:37.040 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2381885794' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:45:37.040 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2069726172' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:45:37.040 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2849243600' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:45:37.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1484655775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:45:37.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4041774816' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:45:37.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/221794258' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:45:37.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2485601427' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:45:37.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1421054202' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:45:37.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1523396988' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:45:37.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1971487059' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:45:37.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1770998371' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:45:37.041 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4262563177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:45:37.042 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.039+0000 7f2962ffd6c0 1 -- 10.20.193.70:0/64536979 <== mgr.14116 v2:10.20.193.70:6800/1747996128 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258898 (secure 0 0 0) 0x7f29740f5e30 con 0x7f29500b5710 2026-02-13T03:45:37.045 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:37.047 INFO:teuthology.orchestra.run.trial070.stderr:dumped all 2026-02-13T03:45:37.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29500b5710 msgr2=0x7f29500d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:37.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29500b5710 0x7f29500d5bc0 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29680023e0 tx=0x7f2968005b00 comp rx=0 tx=0).stop 2026-02-13T03:45:37.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410f230 msgr2=0x7f29740f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:37.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410f230 0x7f29740f4d00 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f296400b710 tx=0x7f296400bbe0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 shutdown_connections 2026-02-13T03:45:37.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f29500b5710 0x7f29500d5bc0 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f29740f5330 0x7f29740fa5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2974115440 0x7f2974175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 --2- 10.20.193.70:0/64536979 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f297410f230 0x7f29740f4d00 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 >> 10.20.193.70:0/64536979 conn(0x7f29740ecb30 msgr2=0x7f297410d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:37.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 shutdown_connections 2026-02-13T03:45:37.050 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.041+0000 7f297bf006c0 1 -- 10.20.193.70:0/64536979 wait complete. 2026-02-13T03:45:37.083 INFO:teuthology.orchestra.run.trial070.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2026-02-13T03:45:35.782355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645426,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":133,"num_read_kb":160,"num_write":257,"num_write_kb":3799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":332868,"kb_used_data":9300,"kb_used_omap":309,"kb_used_meta":323018,"kb_avail":8807705532,"statfs":{"total":9019431321600,"available":9019090464768,"internally_reserved":0,"allocated":9523200,"data_stored":6316998,"data_compressed":114213,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":316953,"internal_metadata":330770919},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55024,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":27,"num_read_kb":69,"num_write":65,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.436017"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347727+0000","last_change":"2026-02-13T03:45:24.355427+0000","last_active":"2026-02-13T03:45:25.347727+0000","last_peered":"2026-02-13T03:45:25.347727+0000","last_clean":"2026-02-13T03:45:25.347727+0000","last_became_active":"2026-02-13T03:45:24.354772+0000","last_became_peered":"2026-02-13T03:45:24.354772+0000","last_unstale":"2026-02-13T03:45:25.347727+0000","last_undegraded":"2026-02-13T03:45:25.347727+0000","last_fullsized":"2026-02-13T03:45:25.347727+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:09.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636233+0000","last_change":"2026-02-13T03:45:24.354062+0000","last_active":"2026-02-13T03:45:25.636233+0000","last_peered":"2026-02-13T03:45:25.636233+0000","last_clean":"2026-02-13T03:45:25.636233+0000","last_became_active":"2026-02-13T03:45:24.353476+0000","last_became_peered":"2026-02-13T03:45:24.353476+0000","last_unstale":"2026-02-13T03:45:25.636233+0000","last_undegraded":"2026-02-13T03:45:25.636233+0000","last_fullsized":"2026-02-13T03:45:25.636233+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:02:42.376217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636183+0000","last_change":"2026-02-13T03:45:24.353519+0000","last_active":"2026-02-13T03:45:25.636183+0000","last_peered":"2026-02-13T03:45:25.636183+0000","last_clean":"2026-02-13T03:45:25.636183+0000","last_became_active":"2026-02-13T03:45:24.352727+0000","last_became_peered":"2026-02-13T03:45:24.352727+0000","last_unstale":"2026-02-13T03:45:25.636183+0000","last_undegraded":"2026-02-13T03:45:25.636183+0000","last_fullsized":"2026-02-13T03:45:25.636183+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:37:43.862075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348181+0000","last_change":"2026-02-13T03:45:24.353099+0000","last_active":"2026-02-13T03:45:25.348181+0000","last_peered":"2026-02-13T03:45:25.348181+0000","last_clean":"2026-02-13T03:45:25.348181+0000","last_became_active":"2026-02-13T03:45:24.352744+0000","last_became_peered":"2026-02-13T03:45:24.352744+0000","last_unstale":"2026-02-13T03:45:25.348181+0000","last_undegraded":"2026-02-13T03:45:25.348181+0000","last_fullsized":"2026-02-13T03:45:25.348181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:10:58.697391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927950+0000","last_change":"2026-02-13T03:45:24.352238+0000","last_active":"2026-02-13T03:45:25.927950+0000","last_peered":"2026-02-13T03:45:25.927950+0000","last_clean":"2026-02-13T03:45:25.927950+0000","last_became_active":"2026-02-13T03:45:24.352093+0000","last_became_peered":"2026-02-13T03:45:24.352093+0000","last_unstale":"2026-02-13T03:45:25.927950+0000","last_undegraded":"2026-02-13T03:45:25.927950+0000","last_fullsized":"2026-02-13T03:45:25.927950+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:40:14.634462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186270+0000","last_change":"2026-02-13T03:45:24.356372+0000","last_active":"2026-02-13T03:45:26.186270+0000","last_peered":"2026-02-13T03:45:26.186270+0000","last_clean":"2026-02-13T03:45:26.186270+0000","last_became_active":"2026-02-13T03:45:24.356087+0000","last_became_peered":"2026-02-13T03:45:24.356087+0000","last_unstale":"2026-02-13T03:45:26.186270+0000","last_undegraded":"2026-02-13T03:45:26.186270+0000","last_fullsized":"2026-02-13T03:45:26.186270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:35:30.419703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421404+0000","last_change":"2026-02-13T03:45:24.356259+0000","last_active":"2026-02-13T03:45:25.421404+0000","last_peered":"2026-02-13T03:45:25.421404+0000","last_clean":"2026-02-13T03:45:25.421404+0000","last_became_active":"2026-02-13T03:45:24.356054+0000","last_became_peered":"2026-02-13T03:45:24.356054+0000","last_unstale":"2026-02-13T03:45:25.421404+0000","last_undegraded":"2026-02-13T03:45:25.421404+0000","last_fullsized":"2026-02-13T03:45:25.421404+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:41:54.530855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850055+0000","last_change":"2026-02-13T03:45:24.355402+0000","last_active":"2026-02-13T03:45:25.850055+0000","last_peered":"2026-02-13T03:45:25.850055+0000","last_clean":"2026-02-13T03:45:25.850055+0000","last_became_active":"2026-02-13T03:45:24.355240+0000","last_became_peered":"2026-02-13T03:45:24.355240+0000","last_unstale":"2026-02-13T03:45:25.850055+0000","last_undegraded":"2026-02-13T03:45:25.850055+0000","last_fullsized":"2026-02-13T03:45:25.850055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:41:11.797331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170279+0000","last_change":"2026-02-13T03:45:24.354542+0000","last_active":"2026-02-13T03:45:26.170279+0000","last_peered":"2026-02-13T03:45:26.170279+0000","last_clean":"2026-02-13T03:45:26.170279+0000","last_became_active":"2026-02-13T03:45:24.354387+0000","last_became_peered":"2026-02-13T03:45:24.354387+0000","last_unstale":"2026-02-13T03:45:26.170279+0000","last_undegraded":"2026-02-13T03:45:26.170279+0000","last_fullsized":"2026-02-13T03:45:26.170279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:45:32.036800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186512+0000","last_change":"2026-02-13T03:45:24.356533+0000","last_active":"2026-02-13T03:45:26.186512+0000","last_peered":"2026-02-13T03:45:26.186512+0000","last_clean":"2026-02-13T03:45:26.186512+0000","last_became_active":"2026-02-13T03:45:24.356262+0000","last_became_peered":"2026-02-13T03:45:24.356262+0000","last_unstale":"2026-02-13T03:45:26.186512+0000","last_undegraded":"2026-02-13T03:45:26.186512+0000","last_fullsized":"2026-02-13T03:45:26.186512+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:10:24.614545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421980+0000","last_change":"2026-02-13T03:45:24.354428+0000","last_active":"2026-02-13T03:45:25.421980+0000","last_peered":"2026-02-13T03:45:25.421980+0000","last_clean":"2026-02-13T03:45:25.421980+0000","last_became_active":"2026-02-13T03:45:24.354241+0000","last_became_peered":"2026-02-13T03:45:24.354241+0000","last_unstale":"2026-02-13T03:45:25.421980+0000","last_undegraded":"2026-02-13T03:45:25.421980+0000","last_fullsized":"2026-02-13T03:45:25.421980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:31.625314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348111+0000","last_change":"2026-02-13T03:45:24.353689+0000","last_active":"2026-02-13T03:45:25.348111+0000","last_peered":"2026-02-13T03:45:25.348111+0000","last_clean":"2026-02-13T03:45:25.348111+0000","last_became_active":"2026-02-13T03:45:24.353518+0000","last_became_peered":"2026-02-13T03:45:24.353518+0000","last_unstale":"2026-02-13T03:45:25.348111+0000","last_undegraded":"2026-02-13T03:45:25.348111+0000","last_fullsized":"2026-02-13T03:45:25.348111+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:20:01.588601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186445+0000","last_change":"2026-02-13T03:45:24.353765+0000","last_active":"2026-02-13T03:45:26.186445+0000","last_peered":"2026-02-13T03:45:26.186445+0000","last_clean":"2026-02-13T03:45:26.186445+0000","last_became_active":"2026-02-13T03:45:24.353522+0000","last_became_peered":"2026-02-13T03:45:24.353522+0000","last_unstale":"2026-02-13T03:45:26.186445+0000","last_undegraded":"2026-02-13T03:45:26.186445+0000","last_fullsized":"2026-02-13T03:45:26.186445+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:46:34.122311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.635973+0000","last_change":"2026-02-13T03:45:24.353969+0000","last_active":"2026-02-13T03:45:25.635973+0000","last_peered":"2026-02-13T03:45:25.635973+0000","last_clean":"2026-02-13T03:45:25.635973+0000","last_became_active":"2026-02-13T03:45:24.353461+0000","last_became_peered":"2026-02-13T03:45:24.353461+0000","last_unstale":"2026-02-13T03:45:25.635973+0000","last_undegraded":"2026-02-13T03:45:25.635973+0000","last_fullsized":"2026-02-13T03:45:25.635973+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:37.206875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.635946+0000","last_change":"2026-02-13T03:45:24.349803+0000","last_active":"2026-02-13T03:45:25.635946+0000","last_peered":"2026-02-13T03:45:25.635946+0000","last_clean":"2026-02-13T03:45:25.635946+0000","last_became_active":"2026-02-13T03:45:24.349591+0000","last_became_peered":"2026-02-13T03:45:24.349591+0000","last_unstale":"2026-02-13T03:45:25.635946+0000","last_undegraded":"2026-02-13T03:45:25.635946+0000","last_fullsized":"2026-02-13T03:45:25.635946+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:37:18.195235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170120+0000","last_change":"2026-02-13T03:45:24.353411+0000","last_active":"2026-02-13T03:45:26.170120+0000","last_peered":"2026-02-13T03:45:26.170120+0000","last_clean":"2026-02-13T03:45:26.170120+0000","last_became_active":"2026-02-13T03:45:24.353278+0000","last_became_peered":"2026-02-13T03:45:24.353278+0000","last_unstale":"2026-02-13T03:45:26.170120+0000","last_undegraded":"2026-02-13T03:45:26.170120+0000","last_fullsized":"2026-02-13T03:45:26.170120+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:49.049280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347746+0000","last_change":"2026-02-13T03:45:24.355567+0000","last_active":"2026-02-13T03:45:25.347746+0000","last_peered":"2026-02-13T03:45:25.347746+0000","last_clean":"2026-02-13T03:45:25.347746+0000","last_became_active":"2026-02-13T03:45:24.354971+0000","last_became_peered":"2026-02-13T03:45:24.354971+0000","last_unstale":"2026-02-13T03:45:25.347746+0000","last_undegraded":"2026-02-13T03:45:25.347746+0000","last_fullsized":"2026-02-13T03:45:25.347746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:35:23.426524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347236+0000","last_change":"2026-02-13T03:45:24.355317+0000","last_active":"2026-02-13T03:45:25.347236+0000","last_peered":"2026-02-13T03:45:25.347236+0000","last_clean":"2026-02-13T03:45:25.347236+0000","last_became_active":"2026-02-13T03:45:24.355131+0000","last_became_peered":"2026-02-13T03:45:24.355131+0000","last_unstale":"2026-02-13T03:45:25.347236+0000","last_undegraded":"2026-02-13T03:45:25.347236+0000","last_fullsized":"2026-02-13T03:45:25.347236+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:18:02.617097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186145+0000","last_change":"2026-02-13T03:45:24.354455+0000","last_active":"2026-02-13T03:45:26.186145+0000","last_peered":"2026-02-13T03:45:26.186145+0000","last_clean":"2026-02-13T03:45:26.186145+0000","last_became_active":"2026-02-13T03:45:24.353604+0000","last_became_peered":"2026-02-13T03:45:24.353604+0000","last_unstale":"2026-02-13T03:45:26.186145+0000","last_undegraded":"2026-02-13T03:45:26.186145+0000","last_fullsized":"2026-02-13T03:45:26.186145+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:48:18.147862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347614+0000","last_change":"2026-02-13T03:45:24.353184+0000","last_active":"2026-02-13T03:45:25.347614+0000","last_peered":"2026-02-13T03:45:25.347614+0000","last_clean":"2026-02-13T03:45:25.347614+0000","last_became_active":"2026-02-13T03:45:24.352982+0000","last_became_peered":"2026-02-13T03:45:24.352982+0000","last_unstale":"2026-02-13T03:45:25.347614+0000","last_undegraded":"2026-02-13T03:45:25.347614+0000","last_fullsized":"2026-02-13T03:45:25.347614+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:42.997383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186389+0000","last_change":"2026-02-13T03:45:24.353667+0000","last_active":"2026-02-13T03:45:26.186389+0000","last_peered":"2026-02-13T03:45:26.186389+0000","last_clean":"2026-02-13T03:45:26.186389+0000","last_became_active":"2026-02-13T03:45:24.353361+0000","last_became_peered":"2026-02-13T03:45:24.353361+0000","last_unstale":"2026-02-13T03:45:26.186389+0000","last_undegraded":"2026-02-13T03:45:26.186389+0000","last_fullsized":"2026-02-13T03:45:26.186389+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:56:51.287334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170246+0000","last_change":"2026-02-13T03:45:24.354416+0000","last_active":"2026-02-13T03:45:26.170246+0000","last_peered":"2026-02-13T03:45:26.170246+0000","last_clean":"2026-02-13T03:45:26.170246+0000","last_became_active":"2026-02-13T03:45:24.354207+0000","last_became_peered":"2026-02-13T03:45:24.354207+0000","last_unstale":"2026-02-13T03:45:26.170246+0000","last_undegraded":"2026-02-13T03:45:26.170246+0000","last_fullsized":"2026-02-13T03:45:26.170246+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:06:10.307319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850064+0000","last_change":"2026-02-13T03:45:24.354597+0000","last_active":"2026-02-13T03:45:25.850064+0000","last_peered":"2026-02-13T03:45:25.850064+0000","last_clean":"2026-02-13T03:45:25.850064+0000","last_became_active":"2026-02-13T03:45:24.354310+0000","last_became_peered":"2026-02-13T03:45:24.354310+0000","last_unstale":"2026-02-13T03:45:25.850064+0000","last_undegraded":"2026-02-13T03:45:25.850064+0000","last_fullsized":"2026-02-13T03:45:25.850064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:55.801674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791080+0000","last_change":"2026-02-13T03:45:24.355114+0000","last_active":"2026-02-13T03:45:25.791080+0000","last_peered":"2026-02-13T03:45:25.791080+0000","last_clean":"2026-02-13T03:45:25.791080+0000","last_became_active":"2026-02-13T03:45:24.353783+0000","last_became_peered":"2026-02-13T03:45:24.353783+0000","last_unstale":"2026-02-13T03:45:25.791080+0000","last_undegraded":"2026-02-13T03:45:25.791080+0000","last_fullsized":"2026-02-13T03:45:25.791080+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:42.747894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850333+0000","last_change":"2026-02-13T03:45:24.356301+0000","last_active":"2026-02-13T03:45:25.850333+0000","last_peered":"2026-02-13T03:45:25.850333+0000","last_clean":"2026-02-13T03:45:25.850333+0000","last_became_active":"2026-02-13T03:45:24.356101+0000","last_became_peered":"2026-02-13T03:45:24.356101+0000","last_unstale":"2026-02-13T03:45:25.850333+0000","last_undegraded":"2026-02-13T03:45:25.850333+0000","last_fullsized":"2026-02-13T03:45:25.850333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:02:39.812365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186262+0000","last_change":"2026-02-13T03:45:24.354631+0000","last_active":"2026-02-13T03:45:26.186262+0000","last_peered":"2026-02-13T03:45:26.186262+0000","last_clean":"2026-02-13T03:45:26.186262+0000","last_became_active":"2026-02-13T03:45:24.354306+0000","last_became_peered":"2026-02-13T03:45:24.354306+0000","last_unstale":"2026-02-13T03:45:26.186262+0000","last_undegraded":"2026-02-13T03:45:26.186262+0000","last_fullsized":"2026-02-13T03:45:26.186262+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:57.612589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347635+0000","last_change":"2026-02-13T03:45:24.354688+0000","last_active":"2026-02-13T03:45:25.347635+0000","last_peered":"2026-02-13T03:45:25.347635+0000","last_clean":"2026-02-13T03:45:25.347635+0000","last_became_active":"2026-02-13T03:45:24.354555+0000","last_became_peered":"2026-02-13T03:45:24.354555+0000","last_unstale":"2026-02-13T03:45:25.347635+0000","last_undegraded":"2026-02-13T03:45:25.347635+0000","last_fullsized":"2026-02-13T03:45:25.347635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:25.329082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186328+0000","last_change":"2026-02-13T03:45:24.349557+0000","last_active":"2026-02-13T03:45:26.186328+0000","last_peered":"2026-02-13T03:45:26.186328+0000","last_clean":"2026-02-13T03:45:26.186328+0000","last_became_active":"2026-02-13T03:45:24.349043+0000","last_became_peered":"2026-02-13T03:45:24.349043+0000","last_unstale":"2026-02-13T03:45:26.186328+0000","last_undegraded":"2026-02-13T03:45:26.186328+0000","last_fullsized":"2026-02-13T03:45:26.186328+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:43.058296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636182+0000","last_change":"2026-02-13T03:45:24.349552+0000","last_active":"2026-02-13T03:45:25.636182+0000","last_peered":"2026-02-13T03:45:25.636182+0000","last_clean":"2026-02-13T03:45:25.636182+0000","last_became_active":"2026-02-13T03:45:24.349020+0000","last_became_peered":"2026-02-13T03:45:24.349020+0000","last_unstale":"2026-02-13T03:45:25.636182+0000","last_undegraded":"2026-02-13T03:45:25.636182+0000","last_fullsized":"2026-02-13T03:45:25.636182+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:11:20.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.185956+0000","last_change":"2026-02-13T03:45:24.354554+0000","last_active":"2026-02-13T03:45:26.185956+0000","last_peered":"2026-02-13T03:45:26.185956+0000","last_clean":"2026-02-13T03:45:26.185956+0000","last_became_active":"2026-02-13T03:45:24.353925+0000","last_became_peered":"2026-02-13T03:45:24.353925+0000","last_unstale":"2026-02-13T03:45:26.185956+0000","last_undegraded":"2026-02-13T03:45:26.185956+0000","last_fullsized":"2026-02-13T03:45:26.185956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:30:45.125643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186026+0000","last_change":"2026-02-13T03:45:24.355744+0000","last_active":"2026-02-13T03:45:26.186026+0000","last_peered":"2026-02-13T03:45:26.186026+0000","last_clean":"2026-02-13T03:45:26.186026+0000","last_became_active":"2026-02-13T03:45:24.355532+0000","last_became_peered":"2026-02-13T03:45:24.355532+0000","last_unstale":"2026-02-13T03:45:26.186026+0000","last_undegraded":"2026-02-13T03:45:26.186026+0000","last_fullsized":"2026-02-13T03:45:26.186026+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:35:14.965253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347444+0000","last_change":"2026-02-13T03:45:24.355681+0000","last_active":"2026-02-13T03:45:25.347444+0000","last_peered":"2026-02-13T03:45:25.347444+0000","last_clean":"2026-02-13T03:45:25.347444+0000","last_became_active":"2026-02-13T03:45:24.355539+0000","last_became_peered":"2026-02-13T03:45:24.355539+0000","last_unstale":"2026-02-13T03:45:25.347444+0000","last_undegraded":"2026-02-13T03:45:25.347444+0000","last_fullsized":"2026-02-13T03:45:25.347444+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:14:16.800666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927954+0000","last_change":"2026-02-13T03:45:24.353034+0000","last_active":"2026-02-13T03:45:25.927954+0000","last_peered":"2026-02-13T03:45:25.927954+0000","last_clean":"2026-02-13T03:45:25.927954+0000","last_became_active":"2026-02-13T03:45:24.352925+0000","last_became_peered":"2026-02-13T03:45:24.352925+0000","last_unstale":"2026-02-13T03:45:25.927954+0000","last_undegraded":"2026-02-13T03:45:25.927954+0000","last_fullsized":"2026-02-13T03:45:25.927954+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:29:42.354130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791049+0000","last_change":"2026-02-13T03:45:23.349400+0000","last_active":"2026-02-13T03:45:25.791049+0000","last_peered":"2026-02-13T03:45:25.791049+0000","last_clean":"2026-02-13T03:45:25.791049+0000","last_became_active":"2026-02-13T03:45:23.349283+0000","last_became_peered":"2026-02-13T03:45:23.349283+0000","last_unstale":"2026-02-13T03:45:25.791049+0000","last_undegraded":"2026-02-13T03:45:25.791049+0000","last_fullsized":"2026-02-13T03:45:25.791049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:43:46.907002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791094+0000","last_change":"2026-02-13T03:45:24.354044+0000","last_active":"2026-02-13T03:45:25.791094+0000","last_peered":"2026-02-13T03:45:25.791094+0000","last_clean":"2026-02-13T03:45:25.791094+0000","last_became_active":"2026-02-13T03:45:24.353314+0000","last_became_peered":"2026-02-13T03:45:24.353314+0000","last_unstale":"2026-02-13T03:45:25.791094+0000","last_undegraded":"2026-02-13T03:45:25.791094+0000","last_fullsized":"2026-02-13T03:45:25.791094+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:21:37.422406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186240+0000","last_change":"2026-02-13T03:45:23.349077+0000","last_active":"2026-02-13T03:45:26.186240+0000","last_peered":"2026-02-13T03:45:26.186240+0000","last_clean":"2026-02-13T03:45:26.186240+0000","last_became_active":"2026-02-13T03:45:23.348867+0000","last_became_peered":"2026-02-13T03:45:23.348867+0000","last_unstale":"2026-02-13T03:45:26.186240+0000","last_undegraded":"2026-02-13T03:45:26.186240+0000","last_fullsized":"2026-02-13T03:45:26.186240+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:47:13.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186082+0000","last_change":"2026-02-13T03:45:23.350107+0000","last_active":"2026-02-13T03:45:26.186082+0000","last_peered":"2026-02-13T03:45:26.186082+0000","last_clean":"2026-02-13T03:45:26.186082+0000","last_became_active":"2026-02-13T03:45:23.349864+0000","last_became_peered":"2026-02-13T03:45:23.349864+0000","last_unstale":"2026-02-13T03:45:26.186082+0000","last_undegraded":"2026-02-13T03:45:26.186082+0000","last_fullsized":"2026-02-13T03:45:26.186082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:12:31.503069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850113+0000","last_change":"2026-02-13T03:45:24.353268+0000","last_active":"2026-02-13T03:45:25.850113+0000","last_peered":"2026-02-13T03:45:25.850113+0000","last_clean":"2026-02-13T03:45:25.850113+0000","last_became_active":"2026-02-13T03:45:24.352994+0000","last_became_peered":"2026-02-13T03:45:24.352994+0000","last_unstale":"2026-02-13T03:45:25.850113+0000","last_undegraded":"2026-02-13T03:45:25.850113+0000","last_fullsized":"2026-02-13T03:45:25.850113+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:34.389196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791178+0000","last_change":"2026-02-13T03:45:23.348540+0000","last_active":"2026-02-13T03:45:25.791178+0000","last_peered":"2026-02-13T03:45:25.791178+0000","last_clean":"2026-02-13T03:45:25.791178+0000","last_became_active":"2026-02-13T03:45:23.348169+0000","last_became_peered":"2026-02-13T03:45:23.348169+0000","last_unstale":"2026-02-13T03:45:25.791178+0000","last_undegraded":"2026-02-13T03:45:25.791178+0000","last_fullsized":"2026-02-13T03:45:25.791178+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:41:37.655572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347232+0000","last_change":"2026-02-13T03:45:24.354464+0000","last_active":"2026-02-13T03:45:25.347232+0000","last_peered":"2026-02-13T03:45:25.347232+0000","last_clean":"2026-02-13T03:45:25.347232+0000","last_became_active":"2026-02-13T03:45:24.354209+0000","last_became_peered":"2026-02-13T03:45:24.354209+0000","last_unstale":"2026-02-13T03:45:25.347232+0000","last_undegraded":"2026-02-13T03:45:25.347232+0000","last_fullsized":"2026-02-13T03:45:25.347232+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:45:06.054136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186496+0000","last_change":"2026-02-13T03:45:23.349686+0000","last_active":"2026-02-13T03:45:26.186496+0000","last_peered":"2026-02-13T03:45:26.186496+0000","last_clean":"2026-02-13T03:45:26.186496+0000","last_became_active":"2026-02-13T03:45:23.349198+0000","last_became_peered":"2026-02-13T03:45:23.349198+0000","last_unstale":"2026-02-13T03:45:26.186496+0000","last_undegraded":"2026-02-13T03:45:26.186496+0000","last_fullsized":"2026-02-13T03:45:26.186496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:57:46.527371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170290+0000","last_change":"2026-02-13T03:45:24.355581+0000","last_active":"2026-02-13T03:45:26.170290+0000","last_peered":"2026-02-13T03:45:26.170290+0000","last_clean":"2026-02-13T03:45:26.170290+0000","last_became_active":"2026-02-13T03:45:24.355429+0000","last_became_peered":"2026-02-13T03:45:24.355429+0000","last_unstale":"2026-02-13T03:45:26.170290+0000","last_undegraded":"2026-02-13T03:45:26.170290+0000","last_fullsized":"2026-02-13T03:45:26.170290+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:49:00.947016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421822+0000","last_change":"2026-02-13T03:45:23.350353+0000","last_active":"2026-02-13T03:45:25.421822+0000","last_peered":"2026-02-13T03:45:25.421822+0000","last_clean":"2026-02-13T03:45:25.421822+0000","last_became_active":"2026-02-13T03:45:23.349728+0000","last_became_peered":"2026-02-13T03:45:23.349728+0000","last_unstale":"2026-02-13T03:45:25.421822+0000","last_undegraded":"2026-02-13T03:45:25.421822+0000","last_fullsized":"2026-02-13T03:45:25.421822+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:21:58.252825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636487+0000","last_change":"2026-02-13T03:45:24.355069+0000","last_active":"2026-02-13T03:45:25.636487+0000","last_peered":"2026-02-13T03:45:25.636487+0000","last_clean":"2026-02-13T03:45:25.636487+0000","last_became_active":"2026-02-13T03:45:24.354927+0000","last_became_peered":"2026-02-13T03:45:24.354927+0000","last_unstale":"2026-02-13T03:45:25.636487+0000","last_undegraded":"2026-02-13T03:45:25.636487+0000","last_fullsized":"2026-02-13T03:45:25.636487+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:55:26.835770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"69'3","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791069+0000","last_change":"2026-02-13T03:45:23.352479+0000","last_active":"2026-02-13T03:45:25.791069+0000","last_peered":"2026-02-13T03:45:25.791069+0000","last_clean":"2026-02-13T03:45:25.791069+0000","last_became_active":"2026-02-13T03:45:23.352227+0000","last_became_peered":"2026-02-13T03:45:23.352227+0000","last_unstale":"2026-02-13T03:45:25.791069+0000","last_undegraded":"2026-02-13T03:45:25.791069+0000","last_fullsized":"2026-02-13T03:45:25.791069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:24:25.395518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170237+0000","last_change":"2026-02-13T03:45:24.353602+0000","last_active":"2026-02-13T03:45:26.170237+0000","last_peered":"2026-02-13T03:45:26.170237+0000","last_clean":"2026-02-13T03:45:26.170237+0000","last_became_active":"2026-02-13T03:45:24.352872+0000","last_became_peered":"2026-02-13T03:45:24.352872+0000","last_unstale":"2026-02-13T03:45:26.170237+0000","last_undegraded":"2026-02-13T03:45:26.170237+0000","last_fullsized":"2026-02-13T03:45:26.170237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:32:38.831095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"70'21","reported_seq":58,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:33.921479+0000","last_change":"2026-02-13T03:45:23.349666+0000","last_active":"2026-02-13T03:45:33.921479+0000","last_peered":"2026-02-13T03:45:33.921479+0000","last_clean":"2026-02-13T03:45:33.921479+0000","last_became_active":"2026-02-13T03:45:23.349482+0000","last_became_peered":"2026-02-13T03:45:23.349482+0000","last_unstale":"2026-02-13T03:45:33.921479+0000","last_undegraded":"2026-02-13T03:45:33.921479+0000","last_fullsized":"2026-02-13T03:45:33.921479+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:36.983368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54004,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":63,"num_write":21,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928003+0000","last_change":"2026-02-13T03:45:24.352564+0000","last_active":"2026-02-13T03:45:25.928003+0000","last_peered":"2026-02-13T03:45:25.928003+0000","last_clean":"2026-02-13T03:45:25.928003+0000","last_became_active":"2026-02-13T03:45:24.352442+0000","last_became_peered":"2026-02-13T03:45:24.352442+0000","last_unstale":"2026-02-13T03:45:25.928003+0000","last_undegraded":"2026-02-13T03:45:25.928003+0000","last_fullsized":"2026-02-13T03:45:25.928003+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:40:35.470403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"69'2","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186086+0000","last_change":"2026-02-13T03:45:23.349943+0000","last_active":"2026-02-13T03:45:26.186086+0000","last_peered":"2026-02-13T03:45:26.186086+0000","last_clean":"2026-02-13T03:45:26.186086+0000","last_became_active":"2026-02-13T03:45:23.349747+0000","last_became_peered":"2026-02-13T03:45:23.349747+0000","last_unstale":"2026-02-13T03:45:26.186086+0000","last_undegraded":"2026-02-13T03:45:26.186086+0000","last_fullsized":"2026-02-13T03:45:26.186086+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:46:29.724224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186270+0000","last_change":"2026-02-13T03:45:24.353731+0000","last_active":"2026-02-13T03:45:26.186270+0000","last_peered":"2026-02-13T03:45:26.186270+0000","last_clean":"2026-02-13T03:45:26.186270+0000","last_became_active":"2026-02-13T03:45:24.353367+0000","last_became_peered":"2026-02-13T03:45:24.353367+0000","last_unstale":"2026-02-13T03:45:26.186270+0000","last_undegraded":"2026-02-13T03:45:26.186270+0000","last_fullsized":"2026-02-13T03:45:26.186270+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:23:13.530630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.790926+0000","last_change":"2026-02-13T03:45:23.348565+0000","last_active":"2026-02-13T03:45:25.790926+0000","last_peered":"2026-02-13T03:45:25.790926+0000","last_clean":"2026-02-13T03:45:25.790926+0000","last_became_active":"2026-02-13T03:45:23.348280+0000","last_became_peered":"2026-02-13T03:45:23.348280+0000","last_unstale":"2026-02-13T03:45:25.790926+0000","last_undegraded":"2026-02-13T03:45:25.790926+0000","last_fullsized":"2026-02-13T03:45:25.790926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:55:08.236742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421805+0000","last_change":"2026-02-13T03:45:24.353067+0000","last_active":"2026-02-13T03:45:25.421805+0000","last_peered":"2026-02-13T03:45:25.421805+0000","last_clean":"2026-02-13T03:45:25.421805+0000","last_became_active":"2026-02-13T03:45:24.352535+0000","last_became_peered":"2026-02-13T03:45:24.352535+0000","last_unstale":"2026-02-13T03:45:25.421805+0000","last_undegraded":"2026-02-13T03:45:25.421805+0000","last_fullsized":"2026-02-13T03:45:25.421805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:32:19.040005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347856+0000","last_change":"2026-02-13T03:45:23.349989+0000","last_active":"2026-02-13T03:45:25.347856+0000","last_peered":"2026-02-13T03:45:25.347856+0000","last_clean":"2026-02-13T03:45:25.347856+0000","last_became_active":"2026-02-13T03:45:23.349774+0000","last_became_peered":"2026-02-13T03:45:23.349774+0000","last_unstale":"2026-02-13T03:45:25.347856+0000","last_undegraded":"2026-02-13T03:45:25.347856+0000","last_fullsized":"2026-02-13T03:45:25.347856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:10.402322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421339+0000","last_change":"2026-02-13T03:45:24.356431+0000","last_active":"2026-02-13T03:45:25.421339+0000","last_peered":"2026-02-13T03:45:25.421339+0000","last_clean":"2026-02-13T03:45:25.421339+0000","last_became_active":"2026-02-13T03:45:24.355854+0000","last_became_peered":"2026-02-13T03:45:24.355854+0000","last_unstale":"2026-02-13T03:45:25.421339+0000","last_undegraded":"2026-02-13T03:45:25.421339+0000","last_fullsized":"2026-02-13T03:45:25.421339+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:23:56.021478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"69'8","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927749+0000","last_change":"2026-02-13T03:45:23.352300+0000","last_active":"2026-02-13T03:45:25.927749+0000","last_peered":"2026-02-13T03:45:25.927749+0000","last_clean":"2026-02-13T03:45:25.927749+0000","last_became_active":"2026-02-13T03:45:23.352176+0000","last_became_peered":"2026-02-13T03:45:23.352176+0000","last_unstale":"2026-02-13T03:45:25.927749+0000","last_undegraded":"2026-02-13T03:45:25.927749+0000","last_fullsized":"2026-02-13T03:45:25.927749+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:10:56.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791150+0000","last_change":"2026-02-13T03:45:24.355963+0000","last_active":"2026-02-13T03:45:25.791150+0000","last_peered":"2026-02-13T03:45:25.791150+0000","last_clean":"2026-02-13T03:45:25.791150+0000","last_became_active":"2026-02-13T03:45:24.354819+0000","last_became_peered":"2026-02-13T03:45:24.354819+0000","last_unstale":"2026-02-13T03:45:25.791150+0000","last_undegraded":"2026-02-13T03:45:25.791150+0000","last_fullsized":"2026-02-13T03:45:25.791150+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:23:36.255505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"69'1","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928091+0000","last_change":"2026-02-13T03:45:23.346399+0000","last_active":"2026-02-13T03:45:25.928091+0000","last_peered":"2026-02-13T03:45:25.928091+0000","last_clean":"2026-02-13T03:45:25.928091+0000","last_became_active":"2026-02-13T03:45:23.346195+0000","last_became_peered":"2026-02-13T03:45:23.346195+0000","last_unstale":"2026-02-13T03:45:25.928091+0000","last_undegraded":"2026-02-13T03:45:25.928091+0000","last_fullsized":"2026-02-13T03:45:25.928091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:40:17.923580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347701+0000","last_change":"2026-02-13T03:45:24.355093+0000","last_active":"2026-02-13T03:45:25.347701+0000","last_peered":"2026-02-13T03:45:25.347701+0000","last_clean":"2026-02-13T03:45:25.347701+0000","last_became_active":"2026-02-13T03:45:24.354967+0000","last_became_peered":"2026-02-13T03:45:24.354967+0000","last_unstale":"2026-02-13T03:45:25.347701+0000","last_undegraded":"2026-02-13T03:45:25.347701+0000","last_fullsized":"2026-02-13T03:45:25.347701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:47.555133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186318+0000","last_change":"2026-02-13T03:45:23.350209+0000","last_active":"2026-02-13T03:45:26.186318+0000","last_peered":"2026-02-13T03:45:26.186318+0000","last_clean":"2026-02-13T03:45:26.186318+0000","last_became_active":"2026-02-13T03:45:23.349865+0000","last_became_peered":"2026-02-13T03:45:23.349865+0000","last_unstale":"2026-02-13T03:45:26.186318+0000","last_undegraded":"2026-02-13T03:45:26.186318+0000","last_fullsized":"2026-02-13T03:45:26.186318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:31:13.959587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.422025+0000","last_change":"2026-02-13T03:45:24.353947+0000","last_active":"2026-02-13T03:45:25.422025+0000","last_peered":"2026-02-13T03:45:25.422025+0000","last_clean":"2026-02-13T03:45:25.422025+0000","last_became_active":"2026-02-13T03:45:24.353550+0000","last_became_peered":"2026-02-13T03:45:24.353550+0000","last_unstale":"2026-02-13T03:45:25.422025+0000","last_undegraded":"2026-02-13T03:45:25.422025+0000","last_fullsized":"2026-02-13T03:45:25.422025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:39.579793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"69'1","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.792532+0000","last_change":"2026-02-13T03:45:23.347676+0000","last_active":"2026-02-13T03:45:26.792532+0000","last_peered":"2026-02-13T03:45:26.792532+0000","last_clean":"2026-02-13T03:45:26.792532+0000","last_became_active":"2026-02-13T03:45:23.347440+0000","last_became_peered":"2026-02-13T03:45:23.347440+0000","last_unstale":"2026-02-13T03:45:26.792532+0000","last_undegraded":"2026-02-13T03:45:26.792532+0000","last_fullsized":"2026-02-13T03:45:26.792532+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:57:40.028323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.420064+0000","last_change":"2026-02-13T03:45:24.356079+0000","last_active":"2026-02-13T03:45:26.420064+0000","last_peered":"2026-02-13T03:45:26.420064+0000","last_clean":"2026-02-13T03:45:26.420064+0000","last_became_active":"2026-02-13T03:45:24.355776+0000","last_became_peered":"2026-02-13T03:45:24.355776+0000","last_unstale":"2026-02-13T03:45:26.420064+0000","last_undegraded":"2026-02-13T03:45:26.420064+0000","last_fullsized":"2026-02-13T03:45:26.420064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:06.447768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186148+0000","last_change":"2026-02-13T03:45:23.352633+0000","last_active":"2026-02-13T03:45:26.186148+0000","last_peered":"2026-02-13T03:45:26.186148+0000","last_clean":"2026-02-13T03:45:26.186148+0000","last_became_active":"2026-02-13T03:45:23.352460+0000","last_became_peered":"2026-02-13T03:45:23.352460+0000","last_unstale":"2026-02-13T03:45:26.186148+0000","last_undegraded":"2026-02-13T03:45:26.186148+0000","last_fullsized":"2026-02-13T03:45:26.186148+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:59.397129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.422048+0000","last_change":"2026-02-13T03:45:24.353603+0000","last_active":"2026-02-13T03:45:25.422048+0000","last_peered":"2026-02-13T03:45:25.422048+0000","last_clean":"2026-02-13T03:45:25.422048+0000","last_became_active":"2026-02-13T03:45:24.353292+0000","last_became_peered":"2026-02-13T03:45:24.353292+0000","last_unstale":"2026-02-13T03:45:25.422048+0000","last_undegraded":"2026-02-13T03:45:25.422048+0000","last_fullsized":"2026-02-13T03:45:25.422048+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:04:30.019967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'152","reported_seq":336,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421413+0000","last_change":"2026-02-13T03:45:01.868042+0000","last_active":"2026-02-13T03:45:25.421413+0000","last_peered":"2026-02-13T03:45:25.421413+0000","last_clean":"2026-02-13T03:45:25.421413+0000","last_became_active":"2026-02-13T03:45:01.867747+0000","last_became_peered":"2026-02-13T03:45:01.867747+0000","last_unstale":"2026-02-13T03:45:25.421413+0000","last_undegraded":"2026-02-13T03:45:25.421413+0000","last_fullsized":"2026-02-13T03:45:25.421413+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:43:59.641267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:43:59.641267+0000","last_clean_scrub_stamp":"2026-02-13T03:43:59.641267+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:48:43.238019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347838+0000","last_change":"2026-02-13T03:45:23.349113+0000","last_active":"2026-02-13T03:45:25.347838+0000","last_peered":"2026-02-13T03:45:25.347838+0000","last_clean":"2026-02-13T03:45:25.347838+0000","last_became_active":"2026-02-13T03:45:23.348948+0000","last_became_peered":"2026-02-13T03:45:23.348948+0000","last_unstale":"2026-02-13T03:45:25.347838+0000","last_undegraded":"2026-02-13T03:45:25.347838+0000","last_fullsized":"2026-02-13T03:45:25.347838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:00:41.357000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850169+0000","last_change":"2026-02-13T03:45:24.354838+0000","last_active":"2026-02-13T03:45:25.850169+0000","last_peered":"2026-02-13T03:45:25.850169+0000","last_clean":"2026-02-13T03:45:25.850169+0000","last_became_active":"2026-02-13T03:45:24.354639+0000","last_became_peered":"2026-02-13T03:45:24.354639+0000","last_unstale":"2026-02-13T03:45:25.850169+0000","last_undegraded":"2026-02-13T03:45:25.850169+0000","last_fullsized":"2026-02-13T03:45:25.850169+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:58:22.121456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421381+0000","last_change":"2026-02-13T03:45:23.349837+0000","last_active":"2026-02-13T03:45:25.421381+0000","last_peered":"2026-02-13T03:45:25.421381+0000","last_clean":"2026-02-13T03:45:25.421381+0000","last_became_active":"2026-02-13T03:45:23.349223+0000","last_became_peered":"2026-02-13T03:45:23.349223+0000","last_unstale":"2026-02-13T03:45:25.421381+0000","last_undegraded":"2026-02-13T03:45:25.421381+0000","last_fullsized":"2026-02-13T03:45:25.421381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:38:18.742824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186170+0000","last_change":"2026-02-13T03:45:24.349832+0000","last_active":"2026-02-13T03:45:26.186170+0000","last_peered":"2026-02-13T03:45:26.186170+0000","last_clean":"2026-02-13T03:45:26.186170+0000","last_became_active":"2026-02-13T03:45:24.349608+0000","last_became_peered":"2026-02-13T03:45:24.349608+0000","last_unstale":"2026-02-13T03:45:26.186170+0000","last_undegraded":"2026-02-13T03:45:26.186170+0000","last_fullsized":"2026-02-13T03:45:26.186170+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:45:53.372675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186175+0000","last_change":"2026-02-13T03:45:23.352560+0000","last_active":"2026-02-13T03:45:26.186175+0000","last_peered":"2026-02-13T03:45:26.186175+0000","last_clean":"2026-02-13T03:45:26.186175+0000","last_became_active":"2026-02-13T03:45:23.352373+0000","last_became_peered":"2026-02-13T03:45:23.352373+0000","last_unstale":"2026-02-13T03:45:26.186175+0000","last_undegraded":"2026-02-13T03:45:26.186175+0000","last_fullsized":"2026-02-13T03:45:26.186175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:13:31.193029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791006+0000","last_change":"2026-02-13T03:45:24.354558+0000","last_active":"2026-02-13T03:45:25.791006+0000","last_peered":"2026-02-13T03:45:25.791006+0000","last_clean":"2026-02-13T03:45:25.791006+0000","last_became_active":"2026-02-13T03:45:24.354213+0000","last_became_peered":"2026-02-13T03:45:24.354213+0000","last_unstale":"2026-02-13T03:45:25.791006+0000","last_undegraded":"2026-02-13T03:45:25.791006+0000","last_fullsized":"2026-02-13T03:45:25.791006+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:21.319355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421761+0000","last_change":"2026-02-13T03:45:23.350556+0000","last_active":"2026-02-13T03:45:25.421761+0000","last_peered":"2026-02-13T03:45:25.421761+0000","last_clean":"2026-02-13T03:45:25.421761+0000","last_became_active":"2026-02-13T03:45:23.349778+0000","last_became_peered":"2026-02-13T03:45:23.349778+0000","last_unstale":"2026-02-13T03:45:25.421761+0000","last_undegraded":"2026-02-13T03:45:25.421761+0000","last_fullsized":"2026-02-13T03:45:25.421761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:30:14.999945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186456+0000","last_change":"2026-02-13T03:45:24.356662+0000","last_active":"2026-02-13T03:45:26.186456+0000","last_peered":"2026-02-13T03:45:26.186456+0000","last_clean":"2026-02-13T03:45:26.186456+0000","last_became_active":"2026-02-13T03:45:24.356145+0000","last_became_peered":"2026-02-13T03:45:24.356145+0000","last_unstale":"2026-02-13T03:45:26.186456+0000","last_undegraded":"2026-02-13T03:45:26.186456+0000","last_fullsized":"2026-02-13T03:45:26.186456+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:52.281060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347168+0000","last_change":"2026-02-13T03:45:23.351917+0000","last_active":"2026-02-13T03:45:25.347168+0000","last_peered":"2026-02-13T03:45:25.347168+0000","last_clean":"2026-02-13T03:45:25.347168+0000","last_became_active":"2026-02-13T03:45:23.351794+0000","last_became_peered":"2026-02-13T03:45:23.351794+0000","last_unstale":"2026-02-13T03:45:25.347168+0000","last_undegraded":"2026-02-13T03:45:25.347168+0000","last_fullsized":"2026-02-13T03:45:25.347168+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:44:15.488304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186500+0000","last_change":"2026-02-13T03:45:24.352772+0000","last_active":"2026-02-13T03:45:26.186500+0000","last_peered":"2026-02-13T03:45:26.186500+0000","last_clean":"2026-02-13T03:45:26.186500+0000","last_became_active":"2026-02-13T03:45:24.352569+0000","last_became_peered":"2026-02-13T03:45:24.352569+0000","last_unstale":"2026-02-13T03:45:26.186500+0000","last_undegraded":"2026-02-13T03:45:26.186500+0000","last_fullsized":"2026-02-13T03:45:26.186500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:33:13.188588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928147+0000","last_change":"2026-02-13T03:45:23.352357+0000","last_active":"2026-02-13T03:45:25.928147+0000","last_peered":"2026-02-13T03:45:25.928147+0000","last_clean":"2026-02-13T03:45:25.928147+0000","last_became_active":"2026-02-13T03:45:23.352192+0000","last_became_peered":"2026-02-13T03:45:23.352192+0000","last_unstale":"2026-02-13T03:45:25.928147+0000","last_undegraded":"2026-02-13T03:45:25.928147+0000","last_fullsized":"2026-02-13T03:45:25.928147+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:07:52.352111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.186361+0000","last_change":"2026-02-13T03:45:24.351804+0000","last_active":"2026-02-13T03:45:26.186361+0000","last_peered":"2026-02-13T03:45:26.186361+0000","last_clean":"2026-02-13T03:45:26.186361+0000","last_became_active":"2026-02-13T03:45:24.351594+0000","last_became_peered":"2026-02-13T03:45:24.351594+0000","last_unstale":"2026-02-13T03:45:26.186361+0000","last_undegraded":"2026-02-13T03:45:26.186361+0000","last_fullsized":"2026-02-13T03:45:26.186361+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:26:57.857287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"70'4","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:29.354554+0000","last_change":"2026-02-13T03:45:23.350776+0000","last_active":"2026-02-13T03:45:29.354554+0000","last_peered":"2026-02-13T03:45:29.354554+0000","last_clean":"2026-02-13T03:45:29.354554+0000","last_became_active":"2026-02-13T03:45:23.350640+0000","last_became_peered":"2026-02-13T03:45:23.350640+0000","last_unstale":"2026-02-13T03:45:29.354554+0000","last_undegraded":"2026-02-13T03:45:29.354554+0000","last_fullsized":"2026-02-13T03:45:29.354554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:52:28.690330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850321+0000","last_change":"2026-02-13T03:45:24.353462+0000","last_active":"2026-02-13T03:45:25.850321+0000","last_peered":"2026-02-13T03:45:25.850321+0000","last_clean":"2026-02-13T03:45:25.850321+0000","last_became_active":"2026-02-13T03:45:24.353125+0000","last_became_peered":"2026-02-13T03:45:24.353125+0000","last_unstale":"2026-02-13T03:45:25.850321+0000","last_undegraded":"2026-02-13T03:45:25.850321+0000","last_fullsized":"2026-02-13T03:45:25.850321+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:28:11.227093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.348198+0000","last_change":"2026-02-13T03:45:23.354142+0000","last_active":"2026-02-13T03:45:25.348198+0000","last_peered":"2026-02-13T03:45:25.348198+0000","last_clean":"2026-02-13T03:45:25.348198+0000","last_became_active":"2026-02-13T03:45:23.353998+0000","last_became_peered":"2026-02-13T03:45:23.353998+0000","last_unstale":"2026-02-13T03:45:25.348198+0000","last_undegraded":"2026-02-13T03:45:25.348198+0000","last_fullsized":"2026-02-13T03:45:25.348198+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:38:02.155173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636264+0000","last_change":"2026-02-13T03:45:24.352663+0000","last_active":"2026-02-13T03:45:25.636264+0000","last_peered":"2026-02-13T03:45:25.636264+0000","last_clean":"2026-02-13T03:45:25.636264+0000","last_became_active":"2026-02-13T03:45:24.352121+0000","last_became_peered":"2026-02-13T03:45:24.352121+0000","last_unstale":"2026-02-13T03:45:25.636264+0000","last_undegraded":"2026-02-13T03:45:25.636264+0000","last_fullsized":"2026-02-13T03:45:25.636264+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:53:59.157080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170156+0000","last_change":"2026-02-13T03:45:23.352681+0000","last_active":"2026-02-13T03:45:26.170156+0000","last_peered":"2026-02-13T03:45:26.170156+0000","last_clean":"2026-02-13T03:45:26.170156+0000","last_became_active":"2026-02-13T03:45:23.352549+0000","last_became_peered":"2026-02-13T03:45:23.352549+0000","last_unstale":"2026-02-13T03:45:26.170156+0000","last_undegraded":"2026-02-13T03:45:26.170156+0000","last_fullsized":"2026-02-13T03:45:26.170156+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:19:36.419406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927843+0000","last_change":"2026-02-13T03:45:24.353993+0000","last_active":"2026-02-13T03:45:25.927843+0000","last_peered":"2026-02-13T03:45:25.927843+0000","last_clean":"2026-02-13T03:45:25.927843+0000","last_became_active":"2026-02-13T03:45:24.353849+0000","last_became_peered":"2026-02-13T03:45:24.353849+0000","last_unstale":"2026-02-13T03:45:25.927843+0000","last_undegraded":"2026-02-13T03:45:25.927843+0000","last_fullsized":"2026-02-13T03:45:25.927843+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:37:28.284522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850035+0000","last_change":"2026-02-13T03:45:23.350245+0000","last_active":"2026-02-13T03:45:25.850035+0000","last_peered":"2026-02-13T03:45:25.850035+0000","last_clean":"2026-02-13T03:45:25.850035+0000","last_became_active":"2026-02-13T03:45:23.349993+0000","last_became_peered":"2026-02-13T03:45:23.349993+0000","last_unstale":"2026-02-13T03:45:25.850035+0000","last_undegraded":"2026-02-13T03:45:25.850035+0000","last_fullsized":"2026-02-13T03:45:25.850035+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:26.787163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.347702+0000","last_change":"2026-02-13T03:45:24.357857+0000","last_active":"2026-02-13T03:45:25.347702+0000","last_peered":"2026-02-13T03:45:25.347702+0000","last_clean":"2026-02-13T03:45:25.347702+0000","last_became_active":"2026-02-13T03:45:24.357686+0000","last_became_peered":"2026-02-13T03:45:24.357686+0000","last_unstale":"2026-02-13T03:45:25.347702+0000","last_undegraded":"2026-02-13T03:45:25.347702+0000","last_fullsized":"2026-02-13T03:45:25.347702+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:18:49.505530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.185913+0000","last_change":"2026-02-13T03:45:23.349986+0000","last_active":"2026-02-13T03:45:26.185913+0000","last_peered":"2026-02-13T03:45:26.185913+0000","last_clean":"2026-02-13T03:45:26.185913+0000","last_became_active":"2026-02-13T03:45:23.349724+0000","last_became_peered":"2026-02-13T03:45:23.349724+0000","last_unstale":"2026-02-13T03:45:26.185913+0000","last_undegraded":"2026-02-13T03:45:26.185913+0000","last_fullsized":"2026-02-13T03:45:26.185913+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:17:32.924039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850162+0000","last_change":"2026-02-13T03:45:24.354082+0000","last_active":"2026-02-13T03:45:25.850162+0000","last_peered":"2026-02-13T03:45:25.850162+0000","last_clean":"2026-02-13T03:45:25.850162+0000","last_became_active":"2026-02-13T03:45:24.353693+0000","last_became_peered":"2026-02-13T03:45:24.353693+0000","last_unstale":"2026-02-13T03:45:25.850162+0000","last_undegraded":"2026-02-13T03:45:25.850162+0000","last_fullsized":"2026-02-13T03:45:25.850162+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:56.149445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"69'2","reported_seq":19,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.927928+0000","last_change":"2026-02-13T03:45:23.349449+0000","last_active":"2026-02-13T03:45:25.927928+0000","last_peered":"2026-02-13T03:45:25.927928+0000","last_clean":"2026-02-13T03:45:25.927928+0000","last_became_active":"2026-02-13T03:45:23.349088+0000","last_became_peered":"2026-02-13T03:45:23.349088+0000","last_unstale":"2026-02-13T03:45:25.927928+0000","last_undegraded":"2026-02-13T03:45:25.927928+0000","last_fullsized":"2026-02-13T03:45:25.927928+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:47:08.987853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.421786+0000","last_change":"2026-02-13T03:45:24.353460+0000","last_active":"2026-02-13T03:45:25.421786+0000","last_peered":"2026-02-13T03:45:25.421786+0000","last_clean":"2026-02-13T03:45:25.421786+0000","last_became_active":"2026-02-13T03:45:24.353234+0000","last_became_peered":"2026-02-13T03:45:24.353234+0000","last_unstale":"2026-02-13T03:45:25.421786+0000","last_undegraded":"2026-02-13T03:45:25.421786+0000","last_fullsized":"2026-02-13T03:45:25.421786+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:09:37.604254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.791188+0000","last_change":"2026-02-13T03:45:24.356273+0000","last_active":"2026-02-13T03:45:25.791188+0000","last_peered":"2026-02-13T03:45:25.791188+0000","last_clean":"2026-02-13T03:45:25.791188+0000","last_became_active":"2026-02-13T03:45:24.355811+0000","last_became_peered":"2026-02-13T03:45:24.355811+0000","last_unstale":"2026-02-13T03:45:25.791188+0000","last_undegraded":"2026-02-13T03:45:25.791188+0000","last_fullsized":"2026-02-13T03:45:25.791188+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:16:38.126683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928123+0000","last_change":"2026-02-13T03:45:23.348661+0000","last_active":"2026-02-13T03:45:25.928123+0000","last_peered":"2026-02-13T03:45:25.928123+0000","last_clean":"2026-02-13T03:45:25.928123+0000","last_became_active":"2026-02-13T03:45:23.348261+0000","last_became_peered":"2026-02-13T03:45:23.348261+0000","last_unstale":"2026-02-13T03:45:25.928123+0000","last_undegraded":"2026-02-13T03:45:25.928123+0000","last_fullsized":"2026-02-13T03:45:25.928123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:55.257025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.170184+0000","last_change":"2026-02-13T03:45:24.354121+0000","last_active":"2026-02-13T03:45:26.170184+0000","last_peered":"2026-02-13T03:45:26.170184+0000","last_clean":"2026-02-13T03:45:26.170184+0000","last_became_active":"2026-02-13T03:45:24.354004+0000","last_became_peered":"2026-02-13T03:45:24.354004+0000","last_unstale":"2026-02-13T03:45:26.170184+0000","last_undegraded":"2026-02-13T03:45:26.170184+0000","last_fullsized":"2026-02-13T03:45:26.170184+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:23:50.879001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"69'2","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.928021+0000","last_change":"2026-02-13T03:45:23.348978+0000","last_active":"2026-02-13T03:45:25.928021+0000","last_peered":"2026-02-13T03:45:25.928021+0000","last_clean":"2026-02-13T03:45:25.928021+0000","last_became_active":"2026-02-13T03:45:23.348824+0000","last_became_peered":"2026-02-13T03:45:23.348824+0000","last_unstale":"2026-02-13T03:45:25.928021+0000","last_undegraded":"2026-02-13T03:45:25.928021+0000","last_fullsized":"2026-02-13T03:45:25.928021+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:46:48.932535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.636503+0000","last_change":"2026-02-13T03:45:24.354516+0000","last_active":"2026-02-13T03:45:25.636503+0000","last_peered":"2026-02-13T03:45:25.636503+0000","last_clean":"2026-02-13T03:45:25.636503+0000","last_became_active":"2026-02-13T03:45:24.353042+0000","last_became_peered":"2026-02-13T03:45:24.353042+0000","last_unstale":"2026-02-13T03:45:25.636503+0000","last_undegraded":"2026-02-13T03:45:25.636503+0000","last_fullsized":"2026-02-13T03:45:25.636503+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:34:41.644225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"69'1","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850303+0000","last_change":"2026-02-13T03:45:23.353085+0000","last_active":"2026-02-13T03:45:25.850303+0000","last_peered":"2026-02-13T03:45:25.850303+0000","last_clean":"2026-02-13T03:45:25.850303+0000","last_became_active":"2026-02-13T03:45:23.352945+0000","last_became_peered":"2026-02-13T03:45:23.352945+0000","last_unstale":"2026-02-13T03:45:25.850303+0000","last_undegraded":"2026-02-13T03:45:25.850303+0000","last_fullsized":"2026-02-13T03:45:25.850303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:59.326051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:25.850314+0000","last_change":"2026-02-13T03:45:24.356661+0000","last_active":"2026-02-13T03:45:25.850314+0000","last_peered":"2026-02-13T03:45:25.850314+0000","last_clean":"2026-02-13T03:45:25.850314+0000","last_became_active":"2026-02-13T03:45:24.356440+0000","last_became_peered":"2026-02-13T03:45:24.356440+0000","last_unstale":"2026-02-13T03:45:25.850314+0000","last_undegraded":"2026-02-13T03:45:25.850314+0000","last_fullsized":"2026-02-13T03:45:25.850314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:23.338559+0000","last_clean_scrub_stamp":"2026-02-13T03:45:23.338559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:20.190644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"69'4","reported_seq":21,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-13T03:45:26.281389+0000","last_change":"2026-02-13T03:45:23.349442+0000","last_active":"2026-02-13T03:45:26.281389+0000","last_peered":"2026-02-13T03:45:26.281389+0000","last_clean":"2026-02-13T03:45:26.281389+0000","last_became_active":"2026-02-13T03:45:23.349265+0000","last_became_peered":"2026-02-13T03:45:23.349265+0000","last_unstale":"2026-02-13T03:45:26.281389+0000","last_undegraded":"2026-02-13T03:45:26.281389+0000","last_fullsized":"2026-02-13T03:45:26.281389+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:45:22.335380+0000","last_clean_scrub_stamp":"2026-02-13T03:45:22.335380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:08:11.896196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54824,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":27,"num_read_kb":69,"num_write":66,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":164472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":62969,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":299612,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":65,"seq":279172874249,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":365060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8466,"internal_metadata":27582190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":58,"seq":249108103178,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27832,"kb_used_data":868,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975368,"statfs":{"total":751619276800,"available":751590776832,"internally_reserved":0,"allocated":888832,"data_stored":1009743,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":18705,"internal_metadata":27571951},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":54,"seq":231928233995,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":16,"kb_used_meta":26927,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17162,"internal_metadata":27573494},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27712,"kb_used_data":748,"kb_used_omap":22,"kb_used_meta":26922,"kb_avail":733975488,"statfs":{"total":751619276800,"available":751590899712,"internally_reserved":0,"allocated":765952,"data_stored":365686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22528,"internal_metadata":27568128},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":40,"seq":171798691853,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":956149,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":23850,"internal_metadata":27566806},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":36,"seq":154618822672,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19432,"internal_metadata":27571224},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":29,"seq":124554051601,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":12,"kb_used_meta":26931,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":955727,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":12636,"internal_metadata":27578020},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":26,"seq":111669149714,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30605,"internal_metadata":27560051},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":19,"seq":81604378644,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27720,"kb_used_data":756,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975480,"statfs":{"total":751619276800,"available":751590891520,"internally_reserved":0,"allocated":774144,"data_stored":365398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33966,"internal_metadata":27556690},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":419098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49132,"internal_metadata":27541524},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672982,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":419064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40057,"internal_metadata":27550599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771097,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":365150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40414,"internal_metadata":27550242},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36419,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38071,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3730,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":54038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8260,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17446,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8820,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2208,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":778,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1892,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":54198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10968,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3420,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T03:45:37.090 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T03:45:37.090 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T03:45:37.090 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-13T03:45:37.091 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:45:37.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: pgmap v192: 97 pgs: 97 active+clean; 630 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 7.3 KiB/s wr, 8 op/s 2026-02-13T03:45:37.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2381885794' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:45:37.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2069726172' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:45:37.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2849243600' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:45:37.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1484655775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:45:37.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4041774816' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:45:37.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/221794258' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:45:37.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2485601427' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:45:37.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1421054202' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:45:37.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1523396988' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:45:37.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1971487059' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:45:37.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1770998371' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:45:37.203 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4262563177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:45:37.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: pgmap v192: 97 pgs: 97 active+clean; 630 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 7.3 KiB/s wr, 8 op/s 2026-02-13T03:45:37.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2381885794' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2069726172' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2849243600' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1484655775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4041774816' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/221794258' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2485601427' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1421054202' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1523396988' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1971487059' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1770998371' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T03:45:37.224 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4262563177' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T03:45:37.240 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:37.370 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.365+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/1584023954 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf4810fc20 msgr2=0x7fdf48114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:37.370 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.365+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/1584023954 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf4810fc20 0x7fdf48114c60 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=12358203649714929160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf300099a0 tx=0x7fdf3002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:37.370 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.365+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/1584023954 shutdown_connections 2026-02-13T03:45:37.370 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.365+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/1584023954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf48115440 0x7fdf48175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.370 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.365+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/1584023954 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf4810fc20 0x7fdf48114c60 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=12358203649714929160 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.370 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.365+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/1584023954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf4810f230 0x7fdf4810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.365+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/1584023954 >> 10.20.193.70:0/1584023954 conn(0x7fdf480ecb30 msgr2=0x7fdf4810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.365+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/1584023954 shutdown_connections 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.365+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/1584023954 wait complete. 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 Processor -- start 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 -- start start 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf4810f230 0x7fdf480f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf48115440 0x7fdf48175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf480f5310 0x7fdf480fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480f5a00 con 0x7fdf480f5310 2026-02-13T03:45:37.371 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480faad0 con 0x7fdf4810f230 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf480fac90 con 0x7fdf48115440 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4d6026c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf480f5310 0x7fdf480fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4d6026c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf480f5310 0x7fdf480fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:39934/0 (socket says 10.20.193.70:39934) 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4d6026c0 1 -- 10.20.193.70:0/3994329316 learned_addr learned my addr 10.20.193.70:0/3994329316 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4ce016c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf4810f230 0x7fdf480f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf3ffff6c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf48115440 0x7fdf48175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4d6026c0 1 -- 10.20.193.70:0/3994329316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf48115440 msgr2=0x7fdf48175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4d6026c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf48115440 0x7fdf48175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4d6026c0 1 -- 10.20.193.70:0/3994329316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf4810f230 msgr2=0x7fdf480f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4d6026c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf4810f230 0x7fdf480f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4d6026c0 1 -- 10.20.193.70:0/3994329316 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf30009590 con 0x7fdf480f5310 2026-02-13T03:45:37.372 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4ce016c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf4810f230 0x7fdf480f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:37.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4d6026c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf480f5310 0x7fdf480fa590 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf44006ea0 tx=0x7fdf4400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:37.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf3dffb6c0 1 -- 10.20.193.70:0/3994329316 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf44003a30 con 0x7fdf480f5310 2026-02-13T03:45:37.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf3dffb6c0 1 -- 10.20.193.70:0/3994329316 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdf440054f0 con 0x7fdf480f5310 2026-02-13T03:45:37.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf480faf70 con 0x7fdf480f5310 2026-02-13T03:45:37.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf3dffb6c0 1 -- 10.20.193.70:0/3994329316 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf4400dcd0 con 0x7fdf480f5310 2026-02-13T03:45:37.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.366+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf480fb700 con 0x7fdf480f5310 2026-02-13T03:45:37.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.367+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf480fb450 con 0x7fdf480f5310 2026-02-13T03:45:37.373 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.368+0000 7fdf3dffb6c0 1 -- 10.20.193.70:0/3994329316 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fdf44003b90 con 0x7fdf480f5310 2026-02-13T03:45:37.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.369+0000 7fdf3dffb6c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdf240b5710 0x7fdf240d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:37.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.369+0000 7fdf4ce016c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdf240b5710 0x7fdf240d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:37.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.369+0000 7fdf3dffb6c0 1 -- 10.20.193.70:0/3994329316 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fdf440e4af0 con 0x7fdf480f5310 2026-02-13T03:45:37.374 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.369+0000 7fdf3dffb6c0 1 -- 10.20.193.70:0/3994329316 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdf4411d5e0 con 0x7fdf480f5310 2026-02-13T03:45:37.375 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.369+0000 7fdf4ce016c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdf240b5710 0x7fdf240d5bc0 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf38004750 tx=0x7fdf38009060 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:37.488 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.486+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdf480f5de0 con 0x7fdf480f5310 2026-02-13T03:45:37.489 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.486+0000 7fdf3dffb6c0 1 -- 10.20.193.70:0/3994329316 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdf440a7550 con 0x7fdf480f5310 2026-02-13T03:45:37.489 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:37.489 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:45:37.490 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdf240b5710 msgr2=0x7fdf240d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:37.490 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdf240b5710 0x7fdf240d5bc0 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf38004750 tx=0x7fdf38009060 comp rx=0 tx=0).stop 2026-02-13T03:45:37.490 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf480f5310 msgr2=0x7fdf480fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:37.490 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf480f5310 0x7fdf480fa590 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf44006ea0 tx=0x7fdf4400cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.491 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 shutdown_connections 2026-02-13T03:45:37.491 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdf240b5710 0x7fdf240d5bc0 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.491 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdf480f5310 0x7fdf480fa590 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.491 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf48115440 0x7fdf48175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.491 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 --2- 10.20.193.70:0/3994329316 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdf4810f230 0x7fdf480f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:37.491 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 >> 10.20.193.70:0/3994329316 conn(0x7fdf480ecb30 msgr2=0x7fdf4810d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:37.491 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 shutdown_connections 2026-02-13T03:45:37.491 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:37.487+0000 7fdf4f0906c0 1 -- 10.20.193.70:0/3994329316 wait complete. 2026-02-13T03:45:38.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:37 trial177 ceph-mon[27082]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:38.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:37 trial177 ceph-mon[27082]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:38.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:37 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3994329316' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:38.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:37 trial127 ceph-mon[26439]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:38.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:37 trial127 ceph-mon[26439]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:38.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:37 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3994329316' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:38.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:37 trial070 ceph-mon[24757]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:38.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:37 trial070 ceph-mon[24757]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:45:38.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:37 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3994329316' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:39.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:38 trial177 ceph-mon[27082]: pgmap v193: 97 pgs: 97 active+clean; 630 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2026-02-13T03:45:39.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:38 trial127 ceph-mon[26439]: pgmap v193: 97 pgs: 97 active+clean; 630 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2026-02-13T03:45:39.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:38 trial070 ceph-mon[24757]: pgmap v193: 97 pgs: 97 active+clean; 630 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2026-02-13T03:45:40.531 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:45:40.648 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:40.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/3750418355 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0115440 msgr2=0x7fc5b0175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:40.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/3750418355 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0115440 0x7fc5b0175de0 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=7785208977299008891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5ac00aa70 tx=0x7fc5ac02fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/3750418355 shutdown_connections 2026-02-13T03:45:40.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/3750418355 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0115440 0x7fc5b0175de0 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=7785208977299008891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/3750418355 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5b010fc20 0x7fc5b0114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/3750418355 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5b010f230 0x7fc5b010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/3750418355 >> 10.20.193.70:0/3750418355 conn(0x7fc5b00ecb30 msgr2=0x7fc5b010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/3750418355 shutdown_connections 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/3750418355 wait complete. 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 Processor -- start 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 -- start start 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5b010f230 0x7fc5b011d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5b0115440 0x7fc5b011d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0122ae0 0x7fc5b0122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b01234f0 con 0x7fc5b0122ae0 2026-02-13T03:45:40.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0123660 con 0x7fc5b010f230 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b7cec6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0123820 con 0x7fc5b0115440 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b62626c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0122ae0 0x7fc5b0122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b62626c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0122ae0 0x7fc5b0122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:39964/0 (socket says 10.20.193.70:39964) 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.761+0000 7fc5b62626c0 1 -- 10.20.193.70:0/872428874 learned_addr learned my addr 10.20.193.70:0/872428874 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b52606c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5b0115440 0x7fc5b011d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b5a616c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5b010f230 0x7fc5b011d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b62626c0 1 -- 10.20.193.70:0/872428874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5b0115440 msgr2=0x7fc5b011d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b62626c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5b0115440 0x7fc5b011d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b62626c0 1 -- 10.20.193.70:0/872428874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5b010f230 msgr2=0x7fc5b011d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b62626c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5b010f230 0x7fc5b011d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b62626c0 1 -- 10.20.193.70:0/872428874 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ac00a660 con 0x7fc5b0122ae0 2026-02-13T03:45:40.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b62626c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0122ae0 0x7fc5b0122f80 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5ac0054b0 tx=0x7fc5ac0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:40.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc59effd6c0 1 -- 10.20.193.70:0/872428874 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc5ac003a30 con 0x7fc5b0122ae0 2026-02-13T03:45:40.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b0163c70 con 0x7fc5b0122ae0 2026-02-13T03:45:40.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc59effd6c0 1 -- 10.20.193.70:0/872428874 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc5ac003b90 con 0x7fc5b0122ae0 2026-02-13T03:45:40.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc59effd6c0 1 -- 10.20.193.70:0/872428874 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc5ac0382f0 con 0x7fc5b0122ae0 2026-02-13T03:45:40.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b01640a0 con 0x7fc5b0122ae0 2026-02-13T03:45:40.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.762+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b0110500 con 0x7fc5b0122ae0 2026-02-13T03:45:40.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.764+0000 7fc59effd6c0 1 -- 10.20.193.70:0/872428874 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fc5ac008260 con 0x7fc5b0122ae0 2026-02-13T03:45:40.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.765+0000 7fc59effd6c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc58c0b5690 0x7fc58c0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:40.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.765+0000 7fc5b5a616c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc58c0b5690 0x7fc58c0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:40.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.765+0000 7fc59effd6c0 1 -- 10.20.193.70:0/872428874 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fc5ac108f60 con 0x7fc5b0122ae0 2026-02-13T03:45:40.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.765+0000 7fc59effd6c0 1 -- 10.20.193.70:0/872428874 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc5ac1093e0 con 0x7fc5b0122ae0 2026-02-13T03:45:40.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.765+0000 7fc5b5a616c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc58c0b5690 0x7fc58c0d5b40 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a0005980 tx=0x7fc5a0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:40.884 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.882+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc5b011e330 con 0x7fc5b0122ae0 2026-02-13T03:45:40.884 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.882+0000 7fc59effd6c0 1 -- 10.20.193.70:0/872428874 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc5ac0cb980 con 0x7fc5b0122ae0 2026-02-13T03:45:40.884 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:40.885 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:45:40.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc58c0b5690 msgr2=0x7fc58c0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:40.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc58c0b5690 0x7fc58c0d5b40 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a0005980 tx=0x7fc5a0005910 comp rx=0 tx=0).stop 2026-02-13T03:45:40.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0122ae0 msgr2=0x7fc5b0122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:40.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0122ae0 0x7fc5b0122f80 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5ac0054b0 tx=0x7fc5ac0054e0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 shutdown_connections 2026-02-13T03:45:40.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc58c0b5690 0x7fc58c0d5b40 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc5b0122ae0 0x7fc5b0122f80 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5b0115440 0x7fc5b011d720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 --2- 10.20.193.70:0/872428874 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc5b010f230 0x7fc5b011d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:40.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 >> 10.20.193.70:0/872428874 conn(0x7fc5b00ecb30 msgr2=0x7fc5b010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:40.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 shutdown_connections 2026-02-13T03:45:40.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:40.883+0000 7fc5b7cec6c0 1 -- 10.20.193.70:0/872428874 wait complete. 2026-02-13T03:45:41.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:40 trial177 ceph-mon[27082]: pgmap v194: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 7.5 KiB/s wr, 8 op/s 2026-02-13T03:45:41.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:40 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/872428874' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:41.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:40 trial127 ceph-mon[26439]: pgmap v194: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 7.5 KiB/s wr, 8 op/s 2026-02-13T03:45:41.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:40 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/872428874' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:41.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:40 trial070 ceph-mon[24757]: pgmap v194: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 7.5 KiB/s wr, 8 op/s 2026-02-13T03:45:41.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:40 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/872428874' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:43.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:42 trial177 ceph-mon[27082]: pgmap v195: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 6.4 KiB/s wr, 4 op/s 2026-02-13T03:45:43.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:42 trial127 ceph-mon[26439]: pgmap v195: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 6.4 KiB/s wr, 4 op/s 2026-02-13T03:45:43.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:42 trial070 ceph-mon[24757]: pgmap v195: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 6.4 KiB/s wr, 4 op/s 2026-02-13T03:45:43.929 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:45:44.049 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:44.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.159+0000 7f12356416c0 1 -- 10.20.193.70:0/1035336003 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f123010fc20 msgr2=0x7f1230114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.159+0000 7f12356416c0 1 --2- 10.20.193.70:0/1035336003 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f123010fc20 0x7f1230114c60 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=2619897859601865234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12180099a0 tx=0x7f121802ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.159+0000 7f12356416c0 1 -- 10.20.193.70:0/1035336003 shutdown_connections 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.159+0000 7f12356416c0 1 --2- 10.20.193.70:0/1035336003 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1230115440 0x7f1230175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.159+0000 7f12356416c0 1 --2- 10.20.193.70:0/1035336003 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f123010fc20 0x7f1230114c60 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=2619897859601865234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.159+0000 7f12356416c0 1 --2- 10.20.193.70:0/1035336003 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010f230 0x7f123010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.159+0000 7f12356416c0 1 -- 10.20.193.70:0/1035336003 >> 10.20.193.70:0/1035336003 conn(0x7f12300ecb30 msgr2=0x7f123010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.159+0000 7f12356416c0 1 -- 10.20.193.70:0/1035336003 shutdown_connections 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.159+0000 7f12356416c0 1 -- 10.20.193.70:0/1035336003 wait complete. 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 Processor -- start 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 -- start start 2026-02-13T03:45:44.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010f230 0x7f12300f4bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1230115440 0x7f1230175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12300f5220 0x7f12300fa4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12300f5910 con 0x7f1230115440 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f12300faa30 con 0x7f12300f5220 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12300fabf0 con 0x7f123010f230 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122e7fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1230115440 0x7f1230175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122e7fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1230115440 0x7f1230175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:39978/0 (socket says 10.20.193.70:39978) 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122e7fc6c0 1 -- 10.20.193.70:0/3850122632 learned_addr learned my addr 10.20.193.70:0/3850122632 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122effd6c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010f230 0x7f12300f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122e7fc6c0 1 -- 10.20.193.70:0/3850122632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010f230 msgr2=0x7f12300f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:44.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122e7fc6c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010f230 0x7f12300f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122e7fc6c0 1 -- 10.20.193.70:0/3850122632 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12300f5220 msgr2=0x7f12300fa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122e7fc6c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12300f5220 0x7f12300fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122e7fc6c0 1 -- 10.20.193.70:0/3850122632 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1218009590 con 0x7f1230115440 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f122e7fc6c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1230115440 0x7f1230175ce0 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12180023c0 tx=0x7f121802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f120ffff6c0 1 -- 10.20.193.70:0/3850122632 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1218002ae0 con 0x7f1230115440 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12300fae70 con 0x7f1230115440 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f120ffff6c0 1 -- 10.20.193.70:0/3850122632 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1218007680 con 0x7f1230115440 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f120ffff6c0 1 -- 10.20.193.70:0/3850122632 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f12180374d0 con 0x7f1230115440 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.160+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12300fb2f0 con 0x7f1230115440 2026-02-13T03:45:44.166 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.161+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1230110500 con 0x7f1230115440 2026-02-13T03:45:44.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.163+0000 7f120ffff6c0 1 -- 10.20.193.70:0/3850122632 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f1218007cb0 con 0x7f1230115440 2026-02-13T03:45:44.167 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.164+0000 7f120ffff6c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f12040b5690 0x7f12040d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:44.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.164+0000 7f122effd6c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f12040b5690 0x7f12040d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:44.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.164+0000 7f120ffff6c0 1 -- 10.20.193.70:0/3850122632 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f1218107d60 con 0x7f1230115440 2026-02-13T03:45:44.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.164+0000 7f120ffff6c0 1 -- 10.20.193.70:0/3850122632 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1218108250 con 0x7f1230115440 2026-02-13T03:45:44.168 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.164+0000 7f122effd6c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f12040b5690 0x7f12040d5b40 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1224005980 tx=0x7f1224005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:44.286 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.285+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f123010f600 con 0x7f1230115440 2026-02-13T03:45:44.287 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:44.287 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:45:44.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.285+0000 7f120ffff6c0 1 -- 10.20.193.70:0/3850122632 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f12180ca7c0 con 0x7f1230115440 2026-02-13T03:45:44.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f12040b5690 msgr2=0x7f12040d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f12040b5690 0x7f12040d5b40 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1224005980 tx=0x7f1224005910 comp rx=0 tx=0).stop 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1230115440 msgr2=0x7f1230175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1230115440 0x7f1230175ce0 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12180023c0 tx=0x7f121802fbf0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 shutdown_connections 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f12040b5690 0x7f12040d5b40 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f12300f5220 0x7f12300fa4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1230115440 0x7f1230175ce0 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 --2- 10.20.193.70:0/3850122632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010f230 0x7f12300f4bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 >> 10.20.193.70:0/3850122632 conn(0x7f12300ecb30 msgr2=0x7f1230113bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 shutdown_connections 2026-02-13T03:45:44.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:44.286+0000 7f12356416c0 1 -- 10.20.193.70:0/3850122632 wait complete. 2026-02-13T03:45:45.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:44 trial177 ceph-mon[27082]: pgmap v196: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 6.1 KiB/s wr, 4 op/s 2026-02-13T03:45:45.202 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:44 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3850122632' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:45.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:44 trial127 ceph-mon[26439]: pgmap v196: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 6.1 KiB/s wr, 4 op/s 2026-02-13T03:45:45.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:44 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3850122632' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:45.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:44 trial070 ceph-mon[24757]: pgmap v196: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 6.1 KiB/s wr, 4 op/s 2026-02-13T03:45:45.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:44 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3850122632' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:47.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:46 trial177 ceph-mon[27082]: pgmap v197: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2026-02-13T03:45:47.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:46 trial127 ceph-mon[26439]: pgmap v197: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2026-02-13T03:45:47.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:46 trial070 ceph-mon[24757]: pgmap v197: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2026-02-13T03:45:47.329 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:45:47.448 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:47.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 -- 10.20.193.70:0/1987909064 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c10fc20 msgr2=0x7f182c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:47.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 --2- 10.20.193.70:0/1987909064 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c10fc20 0x7f182c114c60 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=9354209253587110269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18200099a0 tx=0x7f182002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:47.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 -- 10.20.193.70:0/1987909064 shutdown_connections 2026-02-13T03:45:47.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 --2- 10.20.193.70:0/1987909064 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f182c115440 0x7f182c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 --2- 10.20.193.70:0/1987909064 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c10fc20 0x7f182c114c60 unknown :-1 s=CLOSED pgs=323 gs=1 cs=0 l=1 c_cookie=9354209253587110269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 --2- 10.20.193.70:0/1987909064 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f182c10f230 0x7f182c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 -- 10.20.193.70:0/1987909064 >> 10.20.193.70:0/1987909064 conn(0x7f182c0ecb30 msgr2=0x7f182c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 -- 10.20.193.70:0/1987909064 shutdown_connections 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 -- 10.20.193.70:0/1987909064 wait complete. 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 Processor -- start 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 -- start start 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f182c10f230 0x7f182c0f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f182c115440 0x7f182c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c0f5310 0x7f182c0fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f182c0f5a00 con 0x7f182c0f5310 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f182c0faad0 con 0x7f182c115440 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183330c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f182c0fac90 con 0x7f182c10f230 2026-02-13T03:45:47.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183187e6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c0f5310 0x7f182c0fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183187e6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c0f5310 0x7f182c0fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:51760/0 (socket says 10.20.193.70:51760) 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183187e6c0 1 -- 10.20.193.70:0/2715525287 learned_addr learned my addr 10.20.193.70:0/2715525287 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.561+0000 7f183107d6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f182c10f230 0x7f182c0f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183087c6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f182c115440 0x7f182c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183187e6c0 1 -- 10.20.193.70:0/2715525287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f182c10f230 msgr2=0x7f182c0f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183187e6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f182c10f230 0x7f182c0f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183187e6c0 1 -- 10.20.193.70:0/2715525287 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f182c115440 msgr2=0x7f182c175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183187e6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f182c115440 0x7f182c175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183187e6c0 1 -- 10.20.193.70:0/2715525287 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1820009590 con 0x7f182c0f5310 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183187e6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c0f5310 0x7f182c0fa590 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1828006ea0 tx=0x7f182800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f181a7fc6c0 1 -- 10.20.193.70:0/2715525287 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1828003a30 con 0x7f182c0f5310 2026-02-13T03:45:47.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f181a7fc6c0 1 -- 10.20.193.70:0/2715525287 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f18280054f0 con 0x7f182c0f5310 2026-02-13T03:45:47.568 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f181a7fc6c0 1 -- 10.20.193.70:0/2715525287 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f182800dcd0 con 0x7f182c0f5310 2026-02-13T03:45:47.568 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182c0faf70 con 0x7f182c0f5310 2026-02-13T03:45:47.568 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f182c0fb400 con 0x7f182c0f5310 2026-02-13T03:45:47.568 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.562+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f182c110500 con 0x7f182c0f5310 2026-02-13T03:45:47.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.564+0000 7f181a7fc6c0 1 -- 10.20.193.70:0/2715525287 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f1828003b90 con 0x7f182c0f5310 2026-02-13T03:45:47.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.564+0000 7f181a7fc6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18080b5710 0x7f18080d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:47.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.565+0000 7f183107d6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18080b5710 0x7f18080d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:47.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.565+0000 7f181a7fc6c0 1 -- 10.20.193.70:0/2715525287 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f18280e4900 con 0x7f182c0f5310 2026-02-13T03:45:47.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.565+0000 7f183107d6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18080b5710 0x7f18080d5bc0 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f181c004750 tx=0x7f181c009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:47.569 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.565+0000 7f181a7fc6c0 1 -- 10.20.193.70:0/2715525287 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f18280a7320 con 0x7f182c0f5310 2026-02-13T03:45:47.684 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.682+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f182c10f600 con 0x7f182c0f5310 2026-02-13T03:45:47.685 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.682+0000 7f181a7fc6c0 1 -- 10.20.193.70:0/2715525287 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f182800de60 con 0x7f182c0f5310 2026-02-13T03:45:47.685 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:47.685 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:45:47.686 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18080b5710 msgr2=0x7f18080d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:47.686 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18080b5710 0x7f18080d5bc0 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f181c004750 tx=0x7f181c009390 comp rx=0 tx=0).stop 2026-02-13T03:45:47.686 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c0f5310 msgr2=0x7f182c0fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:47.686 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c0f5310 0x7f182c0fa590 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1828006ea0 tx=0x7f182800cca0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.686 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 shutdown_connections 2026-02-13T03:45:47.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f18080b5710 0x7f18080d5bc0 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f182c0f5310 0x7f182c0fa590 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f182c115440 0x7f182c175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 --2- 10.20.193.70:0/2715525287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f182c10f230 0x7f182c0f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:47.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 >> 10.20.193.70:0/2715525287 conn(0x7f182c0ecb30 msgr2=0x7f182c10d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:47.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 shutdown_connections 2026-02-13T03:45:47.687 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:47.684+0000 7f183330c6c0 1 -- 10.20.193.70:0/2715525287 wait complete. 2026-02-13T03:45:48.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:47 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2715525287' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:48.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:47 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2715525287' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:48.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:47 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2715525287' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:49.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:48 trial127 ceph-mon[26439]: pgmap v198: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2026-02-13T03:45:49.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:48 trial070 ceph-mon[24757]: pgmap v198: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2026-02-13T03:45:49.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:48 trial177 ceph-mon[27082]: pgmap v198: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2026-02-13T03:45:50.726 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:45:50.844 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:50.959 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.955+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3358527902 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac010fc20 msgr2=0x7f9ac0114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:50.960 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.955+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3358527902 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac010fc20 0x7f9ac0114c60 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=12244978017626360495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab00099a0 tx=0x7f9ab002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:50.960 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.955+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3358527902 shutdown_connections 2026-02-13T03:45:50.960 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.955+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3358527902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ac0115440 0x7f9ac0175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:50.960 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.955+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3358527902 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac010fc20 0x7f9ac0114c60 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=12244978017626360495 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:50.960 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.955+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3358527902 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9ac010f230 0x7f9ac010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:50.960 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.955+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3358527902 >> 10.20.193.70:0/3358527902 conn(0x7f9ac00ecb30 msgr2=0x7f9ac010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:50.960 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.955+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3358527902 shutdown_connections 2026-02-13T03:45:50.960 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.955+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3358527902 wait complete. 2026-02-13T03:45:50.960 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 Processor -- start 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 -- start start 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ac010f230 0x7f9ac00f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac0115440 0x7f9ac0175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9ac00f5310 0x7f9ac00fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac00f5a00 con 0x7f9ac0115440 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac00faad0 con 0x7f9ac00f5310 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac00fac90 con 0x7f9ac010f230 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abf7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac0115440 0x7f9ac0175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abf7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac0115440 0x7f9ac0175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:51776/0 (socket says 10.20.193.70:51776) 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abf7fe6c0 1 -- 10.20.193.70:0/3568016763 learned_addr learned my addr 10.20.193.70:0/3568016763 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abffff6c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ac010f230 0x7f9ac00f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:50.961 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac4de66c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9ac00f5310 0x7f9ac00fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abf7fe6c0 1 -- 10.20.193.70:0/3568016763 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ac010f230 msgr2=0x7f9ac00f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abf7fe6c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ac010f230 0x7f9ac00f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abf7fe6c0 1 -- 10.20.193.70:0/3568016763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9ac00f5310 msgr2=0x7f9ac00fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abf7fe6c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9ac00f5310 0x7f9ac00fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abf7fe6c0 1 -- 10.20.193.70:0/3568016763 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab0009590 con 0x7f9ac0115440 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abffff6c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ac010f230 0x7f9ac00f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abf7fe6c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac0115440 0x7f9ac0175ce0 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab00023c0 tx=0x7f9ab002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abd7fa6c0 1 -- 10.20.193.70:0/3568016763 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ab0002ae0 con 0x7f9ac0115440 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abd7fa6c0 1 -- 10.20.193.70:0/3568016763 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9ab0002c40 con 0x7f9ac0115440 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac00faf10 con 0x7f9ac0115440 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9abd7fa6c0 1 -- 10.20.193.70:0/3568016763 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ab00372f0 con 0x7f9ac0115440 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.956+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac00fb390 con 0x7f9ac0115440 2026-02-13T03:45:50.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.957+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac0110500 con 0x7f9ac0115440 2026-02-13T03:45:50.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.958+0000 7f9abd7fa6c0 1 -- 10.20.193.70:0/3568016763 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f9ab0007810 con 0x7f9ac0115440 2026-02-13T03:45:50.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.959+0000 7f9abd7fa6c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9a940b5690 0x7f9a940d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:50.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.959+0000 7f9abffff6c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9a940b5690 0x7f9a940d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:50.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.959+0000 7f9abd7fa6c0 1 -- 10.20.193.70:0/3568016763 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f9ab0107cc0 con 0x7f9ac0115440 2026-02-13T03:45:50.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.959+0000 7f9abffff6c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9a940b5690 0x7f9a940d5b40 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aac004750 tx=0x7f9aac009060 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:50.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:50.959+0000 7f9abd7fa6c0 1 -- 10.20.193.70:0/3568016763 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9ab00ca720 con 0x7f9ac0115440 2026-02-13T03:45:51.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:50 trial070 ceph-mon[24757]: pgmap v199: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2026-02-13T03:45:51.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.078+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9ac010f600 con 0x7f9ac0115440 2026-02-13T03:45:51.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.078+0000 7f9abd7fa6c0 1 -- 10.20.193.70:0/3568016763 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9ab0007e60 con 0x7f9ac0115440 2026-02-13T03:45:51.080 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:51.080 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9a940b5690 msgr2=0x7f9a940d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9a940b5690 0x7f9a940d5b40 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aac004750 tx=0x7f9aac009060 comp rx=0 tx=0).stop 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac0115440 msgr2=0x7f9ac0175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac0115440 0x7f9ac0175ce0 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ab00023c0 tx=0x7f9ab002fbf0 comp rx=0 tx=0).stop 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 shutdown_connections 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f9a940b5690 0x7f9a940d5b40 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9ac00f5310 0x7f9ac00fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9ac0115440 0x7f9ac0175ce0 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 --2- 10.20.193.70:0/3568016763 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ac010f230 0x7f9ac00f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:51.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 >> 10.20.193.70:0/3568016763 conn(0x7f9ac00ecb30 msgr2=0x7f9ac010d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:51.083 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 shutdown_connections 2026-02-13T03:45:51.083 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:51.079+0000 7f9ac68746c0 1 -- 10.20.193.70:0/3568016763 wait complete. 2026-02-13T03:45:51.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:50 trial127 ceph-mon[26439]: pgmap v199: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2026-02-13T03:45:51.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:50 trial177 ceph-mon[27082]: pgmap v199: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2026-02-13T03:45:52.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:51 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3568016763' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:52.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:51 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3568016763' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:52.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:51 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3568016763' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:53.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:52 trial127 ceph-mon[26439]: pgmap v200: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 1 op/s 2026-02-13T03:45:53.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:52 trial070 ceph-mon[24757]: pgmap v200: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 1 op/s 2026-02-13T03:45:53.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:52 trial177 ceph-mon[27082]: pgmap v200: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 1 op/s 2026-02-13T03:45:54.125 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:45:54.244 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:54.362 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.355+0000 7f2b574356c0 1 -- 10.20.193.70:0/3653385946 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 msgr2=0x7f2b5010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:54.362 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.355+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3653385946 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 0x7f2b5010f600 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=8567730800444372007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b400099a0 tx=0x7f2b4002ed20 comp rx=0 tx=0).stop 2026-02-13T03:45:54.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.355+0000 7f2b574356c0 1 -- 10.20.193.70:0/3653385946 shutdown_connections 2026-02-13T03:45:54.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.355+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3653385946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50115440 0x7f2b50175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:54.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.355+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3653385946 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b5010fc20 0x7f2b50114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:54.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.355+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3653385946 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 0x7f2b5010f600 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=8567730800444372007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:54.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.355+0000 7f2b574356c0 1 -- 10.20.193.70:0/3653385946 >> 10.20.193.70:0/3653385946 conn(0x7f2b500ecb30 msgr2=0x7f2b5010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:54.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.355+0000 7f2b574356c0 1 -- 10.20.193.70:0/3653385946 shutdown_connections 2026-02-13T03:45:54.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.355+0000 7f2b574356c0 1 -- 10.20.193.70:0/3653385946 wait complete. 2026-02-13T03:45:54.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b574356c0 1 Processor -- start 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b574356c0 1 -- start start 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b574356c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 0x7f2b5011d270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b574356c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b50115440 0x7f2b5011d7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b574356c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50122b70 0x7f2b50123010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b574356c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50123580 con 0x7f2b5010f230 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b574356c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501236f0 con 0x7f2b50115440 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b574356c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501238b0 con 0x7f2b50122b70 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b551a66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 0x7f2b5011d270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b551a66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 0x7f2b5011d270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:51794/0 (socket says 10.20.193.70:51794) 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b551a66c0 1 -- 10.20.193.70:0/3309055428 learned_addr learned my addr 10.20.193.70:0/3309055428 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:54.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b549a56c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b50115440 0x7f2b5011d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b559a76c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50122b70 0x7f2b50123010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b551a66c0 1 -- 10.20.193.70:0/3309055428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50122b70 msgr2=0x7f2b50123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b551a66c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50122b70 0x7f2b50123010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b551a66c0 1 -- 10.20.193.70:0/3309055428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b50115440 msgr2=0x7f2b5011d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b551a66c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b50115440 0x7f2b5011d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b551a66c0 1 -- 10.20.193.70:0/3309055428 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b40009590 con 0x7f2b5010f230 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b549a56c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b50115440 0x7f2b5011d7b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.356+0000 7f2b551a66c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 0x7f2b5011d270 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b4002f230 tx=0x7f2b4002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.357+0000 7f2b3e7fc6c0 1 -- 10.20.193.70:0/3309055428 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b40002ba0 con 0x7f2b5010f230 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.357+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b50163d00 con 0x7f2b5010f230 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.357+0000 7f2b3e7fc6c0 1 -- 10.20.193.70:0/3309055428 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2b40007680 con 0x7f2b5010f230 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.357+0000 7f2b3e7fc6c0 1 -- 10.20.193.70:0/3309055428 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b40037480 con 0x7f2b5010f230 2026-02-13T03:45:54.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.357+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b50164130 con 0x7f2b5010f230 2026-02-13T03:45:54.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.357+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b50110500 con 0x7f2b5010f230 2026-02-13T03:45:54.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.358+0000 7f2b3e7fc6c0 1 -- 10.20.193.70:0/3309055428 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f2b40002d20 con 0x7f2b5010f230 2026-02-13T03:45:54.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.359+0000 7f2b3e7fc6c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2b2c0b5690 0x7f2b2c0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:54.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.359+0000 7f2b549a56c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2b2c0b5690 0x7f2b2c0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:54.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.359+0000 7f2b3e7fc6c0 1 -- 10.20.193.70:0/3309055428 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f2b40107df0 con 0x7f2b5010f230 2026-02-13T03:45:54.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.359+0000 7f2b549a56c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2b2c0b5690 0x7f2b2c0d5b40 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b44005dc0 tx=0x7f2b44005f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:54.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.359+0000 7f2b3e7fc6c0 1 -- 10.20.193.70:0/3309055428 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2b400ce270 con 0x7f2b5010f230 2026-02-13T03:45:54.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.481+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2b5010fc20 con 0x7f2b5010f230 2026-02-13T03:45:54.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.481+0000 7f2b3e7fc6c0 1 -- 10.20.193.70:0/3309055428 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2b400cd9c0 con 0x7f2b5010f230 2026-02-13T03:45:54.483 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:54.483 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2b2c0b5690 msgr2=0x7f2b2c0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2b2c0b5690 0x7f2b2c0d5b40 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b44005dc0 tx=0x7f2b44005f90 comp rx=0 tx=0).stop 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 msgr2=0x7f2b5011d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 0x7f2b5011d270 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b4002f230 tx=0x7f2b4002fd40 comp rx=0 tx=0).stop 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 shutdown_connections 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2b2c0b5690 0x7f2b2c0d5b40 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50122b70 0x7f2b50123010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2b50115440 0x7f2b5011d7b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 --2- 10.20.193.70:0/3309055428 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2b5010f230 0x7f2b5011d270 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 >> 10.20.193.70:0/3309055428 conn(0x7f2b500ecb30 msgr2=0x7f2b5010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:54.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 shutdown_connections 2026-02-13T03:45:54.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:54.482+0000 7f2b574356c0 1 -- 10.20.193.70:0/3309055428 wait complete. 2026-02-13T03:45:55.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:54 trial127 ceph-mon[26439]: pgmap v201: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 2 op/s 2026-02-13T03:45:55.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:54 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3309055428' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:55.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:54 trial070 ceph-mon[24757]: pgmap v201: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 2 op/s 2026-02-13T03:45:55.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:54 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3309055428' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:55.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:54 trial177 ceph-mon[27082]: pgmap v201: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 2 op/s 2026-02-13T03:45:55.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:54 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3309055428' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:57.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:56 trial127 ceph-mon[26439]: pgmap v202: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:45:57.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:56 trial070 ceph-mon[24757]: pgmap v202: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:45:57.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:56 trial177 ceph-mon[27082]: pgmap v202: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:45:57.526 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:45:57.644 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:45:57.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.761+0000 7fd9681af6c0 1 -- 10.20.193.70:0/3931916254 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd960115420 msgr2=0x7fd960175dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:57.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.761+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/3931916254 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd960115420 0x7fd960175dc0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=6093729974804909629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd95c00aa70 tx=0x7fd95c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.761+0000 7fd9681af6c0 1 -- 10.20.193.70:0/3931916254 shutdown_connections 2026-02-13T03:45:57.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.761+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/3931916254 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd960115420 0x7fd960175dc0 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=6093729974804909629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.761+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/3931916254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd96010fc00 0x7fd960114c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.761+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/3931916254 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd96010f210 0x7fd96010f5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.761+0000 7fd9681af6c0 1 -- 10.20.193.70:0/3931916254 >> 10.20.193.70:0/3931916254 conn(0x7fd9600ecb30 msgr2=0x7fd96010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:57.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.761+0000 7fd9681af6c0 1 -- 10.20.193.70:0/3931916254 shutdown_connections 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.761+0000 7fd9681af6c0 1 -- 10.20.193.70:0/3931916254 wait complete. 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 Processor -- start 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 -- start start 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd96010f210 0x7fd96011d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd960115420 0x7fd96011d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd960122ad0 0x7fd960122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601234e0 con 0x7fd96010f210 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd960123650 con 0x7fd960115420 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd960123810 con 0x7fd960122ad0 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd965f206c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd96010f210 0x7fd96011d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:57.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd965f206c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd96010f210 0x7fd96011d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52022/0 (socket says 10.20.193.70:52022) 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd965f206c0 1 -- 10.20.193.70:0/2181405524 learned_addr learned my addr 10.20.193.70:0/2181405524 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd96571f6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd960115420 0x7fd96011d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd965f206c0 1 -- 10.20.193.70:0/2181405524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd960122ad0 msgr2=0x7fd960122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd965f206c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd960122ad0 0x7fd960122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd965f206c0 1 -- 10.20.193.70:0/2181405524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd960115420 msgr2=0x7fd96011d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd965f206c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd960115420 0x7fd96011d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd965f206c0 1 -- 10.20.193.70:0/2181405524 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c00a660 con 0x7fd96010f210 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd965f206c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd96010f210 0x7fd96011d1d0 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd95000b710 tx=0x7fd95000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd94effd6c0 1 -- 10.20.193.70:0/2181405524 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd950004250 con 0x7fd96010f210 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd960163cc0 con 0x7fd96010f210 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd94effd6c0 1 -- 10.20.193.70:0/2181405524 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd950002d80 con 0x7fd96010f210 2026-02-13T03:45:57.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd94effd6c0 1 -- 10.20.193.70:0/2181405524 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd95000cdc0 con 0x7fd96010f210 2026-02-13T03:45:57.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.762+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd960164150 con 0x7fd96010f210 2026-02-13T03:45:57.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.763+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9601104e0 con 0x7fd96010f210 2026-02-13T03:45:57.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.764+0000 7fd94effd6c0 1 -- 10.20.193.70:0/2181405524 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fd9500028c0 con 0x7fd96010f210 2026-02-13T03:45:57.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.765+0000 7fd94effd6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd93c0b5690 0x7fd93c0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:45:57.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.765+0000 7fd96571f6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd93c0b5690 0x7fd93c0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:45:57.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.765+0000 7fd94effd6c0 1 -- 10.20.193.70:0/2181405524 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fd9500e3c80 con 0x7fd96010f210 2026-02-13T03:45:57.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.765+0000 7fd94effd6c0 1 -- 10.20.193.70:0/2181405524 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd9500aa140 con 0x7fd96010f210 2026-02-13T03:45:57.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.765+0000 7fd96571f6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd93c0b5690 0x7fd93c0d5b40 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd954005980 tx=0x7fd954005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:45:57.883 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.881+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd96010fc00 con 0x7fd96010f210 2026-02-13T03:45:57.883 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.881+0000 7fd94effd6c0 1 -- 10.20.193.70:0/2181405524 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd9500a8c30 con 0x7fd96010f210 2026-02-13T03:45:57.883 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:45:57.884 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd93c0b5690 msgr2=0x7fd93c0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd93c0b5690 0x7fd93c0d5b40 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd954005980 tx=0x7fd954005910 comp rx=0 tx=0).stop 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd96010f210 msgr2=0x7fd96011d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd96010f210 0x7fd96011d1d0 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd95000b710 tx=0x7fd95000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 shutdown_connections 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd93c0b5690 0x7fd93c0d5b40 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd960122ad0 0x7fd960122f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd960115420 0x7fd96011d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 --2- 10.20.193.70:0/2181405524 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd96010f210 0x7fd96011d1d0 unknown :-1 s=CLOSED pgs=330 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:45:57.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 >> 10.20.193.70:0/2181405524 conn(0x7fd9600ecb30 msgr2=0x7fd96010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:45:57.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 shutdown_connections 2026-02-13T03:45:57.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:45:57.882+0000 7fd9681af6c0 1 -- 10.20.193.70:0/2181405524 wait complete. 2026-02-13T03:45:58.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:57 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2181405524' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:58.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:57 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2181405524' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:58.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:57 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2181405524' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:45:59.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:45:58 trial127 ceph-mon[26439]: pgmap v203: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:45:59.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:45:58 trial070 ceph-mon[24757]: pgmap v203: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:45:59.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:45:58 trial177 ceph-mon[27082]: pgmap v203: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:00.928 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:01.049 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:01.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.172+0000 7fda97e156c0 1 -- 10.20.193.70:0/3147910450 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010bac0 msgr2=0x7fda9010be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:01.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.172+0000 7fda97e156c0 1 --2- 10.20.193.70:0/3147910450 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010bac0 0x7fda9010be90 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=10097903671534737805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda80009970 tx=0x7fda8002ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:01.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.172+0000 7fda97e156c0 1 -- 10.20.193.70:0/3147910450 shutdown_connections 2026-02-13T03:46:01.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.172+0000 7fda97e156c0 1 --2- 10.20.193.70:0/3147910450 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda901110d0 0x7fda90111550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.172+0000 7fda97e156c0 1 --2- 10.20.193.70:0/3147910450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fda9010c4b0 0x7fda90110a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.172+0000 7fda97e156c0 1 --2- 10.20.193.70:0/3147910450 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010bac0 0x7fda9010be90 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=10097903671534737805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.172+0000 7fda97e156c0 1 -- 10.20.193.70:0/3147910450 >> 10.20.193.70:0/3147910450 conn(0x7fda900e9770 msgr2=0x7fda90109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:01.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.172+0000 7fda97e156c0 1 -- 10.20.193.70:0/3147910450 shutdown_connections 2026-02-13T03:46:01.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.172+0000 7fda97e156c0 1 -- 10.20.193.70:0/3147910450 wait complete. 2026-02-13T03:46:01.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 Processor -- start 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 -- start start 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda9010bac0 0x7fda90121b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010c4b0 0x7fda90122050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fda901110d0 0x7fda90127410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda90127a60 con 0x7fda9010c4b0 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fda90127bd0 con 0x7fda9010bac0 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fda90127d90 con 0x7fda901110d0 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda953856c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010c4b0 0x7fda90122050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda953856c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010c4b0 0x7fda90122050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52038/0 (socket says 10.20.193.70:52038) 2026-02-13T03:46:01.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda953856c0 1 -- 10.20.193.70:0/1029250703 learned_addr learned my addr 10.20.193.70:0/1029250703 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda95b866c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda9010bac0 0x7fda90121b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda963876c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fda901110d0 0x7fda90127410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda953856c0 1 -- 10.20.193.70:0/1029250703 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fda901110d0 msgr2=0x7fda90127410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda953856c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fda901110d0 0x7fda90127410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda953856c0 1 -- 10.20.193.70:0/1029250703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda9010bac0 msgr2=0x7fda90121b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda953856c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda9010bac0 0x7fda90121b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda953856c0 1 -- 10.20.193.70:0/1029250703 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda80009590 con 0x7fda9010c4b0 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda953856c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010c4b0 0x7fda90122050 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda84005dc0 tx=0x7fda8400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda7effd6c0 1 -- 10.20.193.70:0/1029250703 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda84004250 con 0x7fda9010c4b0 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda7effd6c0 1 -- 10.20.193.70:0/1029250703 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fda84009070 con 0x7fda9010c4b0 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda90128070 con 0x7fda9010c4b0 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda7effd6c0 1 -- 10.20.193.70:0/1029250703 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda8400cd70 con 0x7fda9010c4b0 2026-02-13T03:46:01.179 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.173+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda90168750 con 0x7fda9010c4b0 2026-02-13T03:46:01.180 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.174+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9005fb90 con 0x7fda9010c4b0 2026-02-13T03:46:01.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.175+0000 7fda7effd6c0 1 -- 10.20.193.70:0/1029250703 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fda840028c0 con 0x7fda9010c4b0 2026-02-13T03:46:01.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.176+0000 7fda7effd6c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fda6c0b5710 0x7fda6c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:01.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.176+0000 7fda7effd6c0 1 -- 10.20.193.70:0/1029250703 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7fda840e3a50 con 0x7fda9010c4b0 2026-02-13T03:46:01.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.176+0000 7fda95b866c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fda6c0b5710 0x7fda6c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:01.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.176+0000 7fda7effd6c0 1 -- 10.20.193.70:0/1029250703 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fda840a64b0 con 0x7fda9010c4b0 2026-02-13T03:46:01.181 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.176+0000 7fda95b866c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fda6c0b5710 0x7fda6c0d5bc0 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda800023e0 tx=0x7fda80031f30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:01.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:00 trial127 ceph-mon[26439]: pgmap v204: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:01.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.293+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fda90110a80 con 0x7fda9010c4b0 2026-02-13T03:46:01.295 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:00 trial070 ceph-mon[24757]: pgmap v204: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:01.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.293+0000 7fda7effd6c0 1 -- 10.20.193.70:0/1029250703 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fda840a9660 con 0x7fda9010c4b0 2026-02-13T03:46:01.296 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:01.296 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:01.297 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fda6c0b5710 msgr2=0x7fda6c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:01.297 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fda6c0b5710 0x7fda6c0d5bc0 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda800023e0 tx=0x7fda80031f30 comp rx=0 tx=0).stop 2026-02-13T03:46:01.297 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010c4b0 msgr2=0x7fda90122050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:01.297 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010c4b0 0x7fda90122050 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda84005dc0 tx=0x7fda8400bbb0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.298 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 shutdown_connections 2026-02-13T03:46:01.298 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fda6c0b5710 0x7fda6c0d5bc0 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.298 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fda901110d0 0x7fda90127410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.298 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fda9010c4b0 0x7fda90122050 unknown :-1 s=CLOSED pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.298 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 --2- 10.20.193.70:0/1029250703 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fda9010bac0 0x7fda90121b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:01.298 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 >> 10.20.193.70:0/1029250703 conn(0x7fda900e9770 msgr2=0x7fda90109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:01.298 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 shutdown_connections 2026-02-13T03:46:01.298 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:01.295+0000 7fda97e156c0 1 -- 10.20.193.70:0/1029250703 wait complete. 2026-02-13T03:46:01.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:00 trial177 ceph-mon[27082]: pgmap v204: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:02.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:01 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1029250703' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:02.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:01 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1029250703' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:02.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:01 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1029250703' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:03.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: pgmap v205: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2026-02-13T03:46:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2026-02-13T03:46:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-13T03:46:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2026-02-13T03:46:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2026-02-13T03:46:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2026-02-13T03:46:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]} : dispatch 2026-02-13T03:46:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2026-02-13T03:46:03.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:02 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2026-02-13T03:46:03.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: pgmap v205: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:03.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2026-02-13T03:46:03.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2026-02-13T03:46:03.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-13T03:46:03.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2026-02-13T03:46:03.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2026-02-13T03:46:03.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2026-02-13T03:46:03.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]} : dispatch 2026-02-13T03:46:03.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2026-02-13T03:46:03.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:02 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2026-02-13T03:46:03.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: pgmap v205: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:03.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2026-02-13T03:46:03.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2026-02-13T03:46:03.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-13T03:46:03.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2026-02-13T03:46:03.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]} : dispatch 2026-02-13T03:46:03.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2026-02-13T03:46:03.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]} : dispatch 2026-02-13T03:46:03.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2026-02-13T03:46:03.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:02 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2026-02-13T03:46:04.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2026-02-13T03:46:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-13T03:46:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-13T03:46:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2026-02-13T03:46:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2026-02-13T03:46:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2026-02-13T03:46:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]': finished 2026-02-13T03:46:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2026-02-13T03:46:04.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2026-02-13T03:46:04.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:03 trial070 ceph-mon[24757]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T03:46:04.342 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:04.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2026-02-13T03:46:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-13T03:46:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-13T03:46:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2026-02-13T03:46:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2026-02-13T03:46:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2026-02-13T03:46:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]': finished 2026-02-13T03:46:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2026-02-13T03:46:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2026-02-13T03:46:04.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:03 trial177 ceph-mon[27082]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T03:46:04.461 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2026-02-13T03:46:04.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-13T03:46:04.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-13T03:46:04.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2026-02-13T03:46:04.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2026-02-13T03:46:04.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2026-02-13T03:46:04.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]': finished 2026-02-13T03:46:04.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2026-02-13T03:46:04.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2026-02-13T03:46:04.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:03 trial127 ceph-mon[26439]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T03:46:04.587 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 -- 10.20.193.70:0/124835010 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f638810f200 msgr2=0x7f638810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:04.587 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/124835010 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f638810f200 0x7f638810f5d0 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=15020204956520806294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f637c0099a0 tx=0x7f637c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:04.587 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 -- 10.20.193.70:0/124835010 shutdown_connections 2026-02-13T03:46:04.587 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/124835010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6388115410 0x7f6388175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.587 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/124835010 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f638810fbf0 0x7f6388114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.588 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/124835010 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f638810f200 0x7f638810f5d0 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=15020204956520806294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.588 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 -- 10.20.193.70:0/124835010 >> 10.20.193.70:0/124835010 conn(0x7f63880ecb00 msgr2=0x7f638810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:04.588 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 -- 10.20.193.70:0/124835010 shutdown_connections 2026-02-13T03:46:04.588 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 -- 10.20.193.70:0/124835010 wait complete. 2026-02-13T03:46:04.588 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 Processor -- start 2026-02-13T03:46:04.588 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 -- start start 2026-02-13T03:46:04.588 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638810f200 0x7f638811d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:04.588 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6388115410 0x7f638811d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6388122c50 0x7f63881230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6388123660 con 0x7f6388122c50 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f63881237d0 con 0x7f6388115410 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f638d15b6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6388123990 con 0x7f638810f200 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63875776c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6388122c50 0x7f63881230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63875776c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6388122c50 0x7f63881230f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52056/0 (socket says 10.20.193.70:52056) 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63875776c0 1 -- 10.20.193.70:0/850869476 learned_addr learned my addr 10.20.193.70:0/850869476 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f6386d766c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638810f200 0x7f638811d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63865756c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6388115410 0x7f638811d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63875776c0 1 -- 10.20.193.70:0/850869476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638810f200 msgr2=0x7f638811d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63875776c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638810f200 0x7f638811d350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.589 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63875776c0 1 -- 10.20.193.70:0/850869476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6388115410 msgr2=0x7f638811d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63875776c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6388115410 0x7f638811d890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63875776c0 1 -- 10.20.193.70:0/850869476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c009590 con 0x7f6388122c50 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.583+0000 7f63865756c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6388115410 0x7f638811d890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.584+0000 7f63875776c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6388122c50 0x7f63881230f0 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6378006ea0 tx=0x7f637800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.584+0000 7f6367fff6c0 1 -- 10.20.193.70:0/850869476 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6378003a30 con 0x7f6388122c50 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.584+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6388163e40 con 0x7f6388122c50 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.584+0000 7f6367fff6c0 1 -- 10.20.193.70:0/850869476 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f63780054f0 con 0x7f6388122c50 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.584+0000 7f6367fff6c0 1 -- 10.20.193.70:0/850869476 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f637800dcd0 con 0x7f6388122c50 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.584+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63881642d0 con 0x7f6388122c50 2026-02-13T03:46:04.590 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.584+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63881104d0 con 0x7f6388122c50 2026-02-13T03:46:04.591 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.586+0000 7f6367fff6c0 1 -- 10.20.193.70:0/850869476 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f6378005030 con 0x7f6388122c50 2026-02-13T03:46:04.592 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.586+0000 7f6367fff6c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f635c0b5690 0x7f635c0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:04.592 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.586+0000 7f6386d766c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f635c0b5690 0x7f635c0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:04.592 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.586+0000 7f6367fff6c0 1 -- 10.20.193.70:0/850869476 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f63780e4d10 con 0x7f6388122c50 2026-02-13T03:46:04.592 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.587+0000 7f6367fff6c0 1 -- 10.20.193.70:0/850869476 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f63780aa600 con 0x7f6388122c50 2026-02-13T03:46:04.592 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.587+0000 7f6386d766c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f635c0b5690 0x7f635c0d5b40 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f637c0092e0 tx=0x7f637c005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:04.705 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.703+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f638811e4d0 con 0x7f6388122c50 2026-02-13T03:46:04.705 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.703+0000 7f6367fff6c0 1 -- 10.20.193.70:0/850869476 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f63780aa7e0 con 0x7f6388122c50 2026-02-13T03:46:04.705 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:04.705 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f635c0b5690 msgr2=0x7f635c0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f635c0b5690 0x7f635c0d5b40 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f637c0092e0 tx=0x7f637c005c00 comp rx=0 tx=0).stop 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6388122c50 msgr2=0x7f63881230f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6388122c50 0x7f63881230f0 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6378006ea0 tx=0x7f637800cca0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 shutdown_connections 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f635c0b5690 0x7f635c0d5b40 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6388122c50 0x7f63881230f0 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6388115410 0x7f638811d890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 --2- 10.20.193.70:0/850869476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f638810f200 0x7f638811d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 >> 10.20.193.70:0/850869476 conn(0x7f63880ecb00 msgr2=0x7f638810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 shutdown_connections 2026-02-13T03:46:04.706 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:04.704+0000 7f638d15b6c0 1 -- 10.20.193.70:0/850869476 wait complete. 2026-02-13T03:46:05.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:04 trial070 ceph-mon[24757]: pgmap v207: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1023 B/s rd, 1 op/s 2026-02-13T03:46:05.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:04 trial070 ceph-mon[24757]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T03:46:05.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:04 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/850869476' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:05.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:04 trial177 ceph-mon[27082]: pgmap v207: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1023 B/s rd, 1 op/s 2026-02-13T03:46:05.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:04 trial177 ceph-mon[27082]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T03:46:05.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:04 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/850869476' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:04 trial127 ceph-mon[26439]: pgmap v207: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1023 B/s rd, 1 op/s 2026-02-13T03:46:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:04 trial127 ceph-mon[26439]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T03:46:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:04 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/850869476' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:07.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:06 trial070 ceph-mon[24757]: pgmap v209: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:07.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:06 trial177 ceph-mon[27082]: pgmap v209: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:07.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:06 trial127 ceph-mon[26439]: pgmap v209: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:07.746 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:07.864 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:07.984 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.979+0000 7f74ecead6c0 1 -- 10.20.193.70:0/1711839601 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 msgr2=0x7f74e8173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:07.984 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.979+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/1711839601 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 0x7f74e8173b60 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=10091016382028992748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74d800aa70 tx=0x7f74d802fde0 comp rx=0 tx=0).stop 2026-02-13T03:46:07.984 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 -- 10.20.193.70:0/1711839601 shutdown_connections 2026-02-13T03:46:07.984 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/1711839601 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 0x7f74e8173b60 unknown :-1 s=CLOSED pgs=335 gs=1 cs=0 l=1 c_cookie=10091016382028992748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:07.984 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/1711839601 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f74e810d9a0 0x7f74e81129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:07.984 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/1711839601 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74e810cfb0 0x7f74e810d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:07.984 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 -- 10.20.193.70:0/1711839601 >> 10.20.193.70:0/1711839601 conn(0x7f74e80ea8b0 msgr2=0x7f74e810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 -- 10.20.193.70:0/1711839601 shutdown_connections 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 -- 10.20.193.70:0/1711839601 wait complete. 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 Processor -- start 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 -- start start 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f74e810cfb0 0x7f74e811b000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 0x7f74e811b540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74e8120900 0x7f74e8120da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8121310 con 0x7f74e81131c0 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8121480 con 0x7f74e810cfb0 2026-02-13T03:46:07.985 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74ecead6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8121640 con 0x7f74e8120900 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e5d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 0x7f74e811b540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e5d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 0x7f74e811b540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:49564/0 (socket says 10.20.193.70:49564) 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e5d746c0 1 -- 10.20.193.70:0/2699559656 learned_addr learned my addr 10.20.193.70:0/2699559656 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e6d766c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74e8120900 0x7f74e8120da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e5d746c0 1 -- 10.20.193.70:0/2699559656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74e8120900 msgr2=0x7f74e8120da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e5d746c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74e8120900 0x7f74e8120da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e5d746c0 1 -- 10.20.193.70:0/2699559656 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f74e810cfb0 msgr2=0x7f74e811b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e65756c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f74e810cfb0 0x7f74e811b000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e5d746c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f74e810cfb0 0x7f74e811b000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:07.986 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e5d746c0 1 -- 10.20.193.70:0/2699559656 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d800a660 con 0x7f74e81131c0 2026-02-13T03:46:07.987 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e65756c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f74e810cfb0 0x7f74e811b000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:46:07.987 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.980+0000 7f74e5d746c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 0x7f74e811b540 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74d0005dc0 tx=0x7f74d000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:07.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.982+0000 7f74cf7fe6c0 1 -- 10.20.193.70:0/2699559656 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74d0004250 con 0x7f74e81131c0 2026-02-13T03:46:07.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.982+0000 7f74cf7fe6c0 1 -- 10.20.193.70:0/2699559656 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f74d0009070 con 0x7f74e81131c0 2026-02-13T03:46:07.988 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.982+0000 7f74cf7fe6c0 1 -- 10.20.193.70:0/2699559656 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74d000cd50 con 0x7f74e81131c0 2026-02-13T03:46:07.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.982+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e8161af0 con 0x7f74e81131c0 2026-02-13T03:46:07.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.982+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e8161f80 con 0x7f74e81131c0 2026-02-13T03:46:07.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.983+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e810e280 con 0x7f74e81131c0 2026-02-13T03:46:07.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.984+0000 7f74cf7fe6c0 1 -- 10.20.193.70:0/2699559656 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f74d00028c0 con 0x7f74e81131c0 2026-02-13T03:46:07.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.985+0000 7f74cf7fe6c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74c00b5690 0x7f74c00d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:07.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.985+0000 7f74e65756c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74c00b5690 0x7f74c00d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:07.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.985+0000 7f74cf7fe6c0 1 -- 10.20.193.70:0/2699559656 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f74d00e3be0 con 0x7f74e81131c0 2026-02-13T03:46:07.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.985+0000 7f74e65756c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74c00b5690 0x7f74c00d5b40 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74dc004750 tx=0x7f74dc005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:07.989 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:07.986+0000 7f74cf7fe6c0 1 -- 10.20.193.70:0/2699559656 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f74d00a6540 con 0x7f74e81131c0 2026-02-13T03:46:08.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.103+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f74e810d380 con 0x7f74e81131c0 2026-02-13T03:46:08.106 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.103+0000 7f74cf7fe6c0 1 -- 10.20.193.70:0/2699559656 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f74d00a96f0 con 0x7f74e81131c0 2026-02-13T03:46:08.106 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:08.107 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:08.107 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74c00b5690 msgr2=0x7f74c00d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:08.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74c00b5690 0x7f74c00d5b40 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74dc004750 tx=0x7f74dc005f10 comp rx=0 tx=0).stop 2026-02-13T03:46:08.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 msgr2=0x7f74e811b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:08.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 0x7f74e811b540 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74d0005dc0 tx=0x7f74d000bbb0 comp rx=0 tx=0).stop 2026-02-13T03:46:08.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 shutdown_connections 2026-02-13T03:46:08.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74c00b5690 0x7f74c00d5b40 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:08.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74e8120900 0x7f74e8120da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:08.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f74e81131c0 0x7f74e811b540 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:08.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 --2- 10.20.193.70:0/2699559656 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f74e810cfb0 0x7f74e811b000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:08.108 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 >> 10.20.193.70:0/2699559656 conn(0x7f74e80ea8b0 msgr2=0x7f74e810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:08.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 shutdown_connections 2026-02-13T03:46:08.109 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:08.104+0000 7f74ecead6c0 1 -- 10.20.193.70:0/2699559656 wait complete. 2026-02-13T03:46:09.275 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:08 trial127 ceph-mon[26439]: pgmap v210: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:09.275 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:08 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2699559656' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:09.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:08 trial070 ceph-mon[24757]: pgmap v210: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:09.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:08 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2699559656' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:09.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:08 trial177 ceph-mon[27082]: pgmap v210: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:09.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:08 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2699559656' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:11.148 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:11.265 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:11.289 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:10 trial070 ceph-mon[24757]: pgmap v211: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:11.388 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3206037642 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 msgr2=0x7f90741551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:11.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3206037642 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 0x7f90741551a0 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=14710483683663324986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068009970 tx=0x7f906802ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:11.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3206037642 shutdown_connections 2026-02-13T03:46:11.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3206037642 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f90741556e0 0x7f9074175ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:11.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3206037642 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 0x7f90741551a0 unknown :-1 s=CLOSED pgs=337 gs=1 cs=0 l=1 c_cookie=14710483683663324986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:11.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3206037642 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9074060720 0x7f9074060af0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:11.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3206037642 >> 10.20.193.70:0/3206037642 conn(0x7f90740ea8b0 msgr2=0x7f907410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:11.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3206037642 shutdown_connections 2026-02-13T03:46:11.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3206037642 wait complete. 2026-02-13T03:46:11.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 Processor -- start 2026-02-13T03:46:11.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- start start 2026-02-13T03:46:11.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9074060720 0x7f9074161640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:11.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 0x7f9074161b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:11.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90741556e0 0x7f9074166f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:11.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9074167590 con 0x7f9074061030 2026-02-13T03:46:11.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f9074167700 con 0x7f9074060720 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90741678c0 con 0x7f90741556e0 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907888b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 0x7f9074161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907888b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 0x7f9074161b80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:49584/0 (socket says 10.20.193.70:49584) 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907888b6c0 1 -- 10.20.193.70:0/3384985338 learned_addr learned my addr 10.20.193.70:0/3384985338 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907908c6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9074060720 0x7f9074161640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907988d6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90741556e0 0x7f9074166f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907888b6c0 1 -- 10.20.193.70:0/3384985338 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90741556e0 msgr2=0x7f9074166f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907888b6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90741556e0 0x7f9074166f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907888b6c0 1 -- 10.20.193.70:0/3384985338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9074060720 msgr2=0x7f9074161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907888b6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9074060720 0x7f9074161640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907888b6c0 1 -- 10.20.193.70:0/3384985338 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9068009590 con 0x7f9074061030 2026-02-13T03:46:11.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907988d6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90741556e0 0x7f9074166f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:46:11.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907888b6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 0x7f9074161b80 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068031fd0 tx=0x7f906802fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:11.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f90627fc6c0 1 -- 10.20.193.70:0/3384985338 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9068002ae0 con 0x7f9074061030 2026-02-13T03:46:11.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f90627fc6c0 1 -- 10.20.193.70:0/3384985338 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9068002c40 con 0x7f9074061030 2026-02-13T03:46:11.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9074167b40 con 0x7f9074061030 2026-02-13T03:46:11.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f90627fc6c0 1 -- 10.20.193.70:0/3384985338 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90680362f0 con 0x7f9074061030 2026-02-13T03:46:11.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.385+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9074151310 con 0x7f9074061030 2026-02-13T03:46:11.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.386+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9074061c30 con 0x7f9074061030 2026-02-13T03:46:11.393 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.387+0000 7f90627fc6c0 1 -- 10.20.193.70:0/3384985338 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f9068007810 con 0x7f9074061030 2026-02-13T03:46:11.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.388+0000 7f90627fc6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90500b5690 0x7f90500d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:11.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.388+0000 7f907908c6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90500b5690 0x7f90500d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:11.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.388+0000 7f90627fc6c0 1 -- 10.20.193.70:0/3384985338 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f9068107df0 con 0x7f9074061030 2026-02-13T03:46:11.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.388+0000 7f907908c6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90500b5690 0x7f90500d5b40 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9064004750 tx=0x7f9064009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:11.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.388+0000 7f90627fc6c0 1 -- 10.20.193.70:0/3384985338 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f90680ca710 con 0x7f9074061030 2026-02-13T03:46:11.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:10 trial177 ceph-mon[27082]: pgmap v211: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:11.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:10 trial127 ceph-mon[26439]: pgmap v211: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:11.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.506+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9074162790 con 0x7f9074061030 2026-02-13T03:46:11.508 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.506+0000 7f90627fc6c0 1 -- 10.20.193.70:0/3384985338 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f90680cd8c0 con 0x7f9074061030 2026-02-13T03:46:11.509 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:11.509 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:11.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90500b5690 msgr2=0x7f90500d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:11.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90500b5690 0x7f90500d5b40 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9064004750 tx=0x7f9064009390 comp rx=0 tx=0).stop 2026-02-13T03:46:11.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 msgr2=0x7f9074161b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:11.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 0x7f9074161b80 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9068031fd0 tx=0x7f906802fc00 comp rx=0 tx=0).stop 2026-02-13T03:46:11.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 shutdown_connections 2026-02-13T03:46:11.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f90500b5690 0x7f90500d5b40 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:11.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90741556e0 0x7f9074166f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:11.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9074061030 0x7f9074161b80 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:11.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 --2- 10.20.193.70:0/3384985338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9074060720 0x7f9074161640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:11.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 >> 10.20.193.70:0/3384985338 conn(0x7f90740ea8b0 msgr2=0x7f907410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:11.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 shutdown_connections 2026-02-13T03:46:11.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:11.507+0000 7f907b31b6c0 1 -- 10.20.193.70:0/3384985338 wait complete. 2026-02-13T03:46:12.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:11 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3384985338' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:12.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:11 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3384985338' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:12.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:11 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3384985338' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:13.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:12 trial070 ceph-mon[24757]: pgmap v212: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:13.352 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:12 trial177 ceph-mon[27082]: pgmap v212: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:13.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:12 trial127 ceph-mon[26439]: pgmap v212: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:14.550 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:14.667 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:14.795 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.792+0000 7fa0a06406c0 1 -- 10.20.193.70:0/4088852793 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa09810f230 msgr2=0x7fa09810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.792+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/4088852793 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa09810f230 0x7fa09810f600 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=441642618685937894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0880099a0 tx=0x7fa08802ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.792+0000 7fa0a06406c0 1 -- 10.20.193.70:0/4088852793 shutdown_connections 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.792+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/4088852793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa098115440 0x7fa098175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.792+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/4088852793 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa09810fc20 0x7fa098114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.792+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/4088852793 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa09810f230 0x7fa09810f600 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=441642618685937894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.792+0000 7fa0a06406c0 1 -- 10.20.193.70:0/4088852793 >> 10.20.193.70:0/4088852793 conn(0x7fa0980ecb30 msgr2=0x7fa09810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.792+0000 7fa0a06406c0 1 -- 10.20.193.70:0/4088852793 shutdown_connections 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.792+0000 7fa0a06406c0 1 -- 10.20.193.70:0/4088852793 wait complete. 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 Processor -- start 2026-02-13T03:46:14.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 -- start start 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa09810f230 0x7fa09811d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa098115440 0x7fa09811d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa098122cb0 0x7fa098123150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0981236c0 con 0x7fa098122cb0 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa098123830 con 0x7fa09810f230 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa0981239f0 con 0x7fa098115440 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09ebb26c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa098122cb0 0x7fa098123150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09ebb26c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa098122cb0 0x7fa098123150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:49604/0 (socket says 10.20.193.70:49604) 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09ebb26c0 1 -- 10.20.193.70:0/965303166 learned_addr learned my addr 10.20.193.70:0/965303166 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09e3b16c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa09810f230 0x7fa09811d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:14.797 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09dbb06c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa098115440 0x7fa09811d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09ebb26c0 1 -- 10.20.193.70:0/965303166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa098115440 msgr2=0x7fa09811d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09ebb26c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa098115440 0x7fa09811d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09ebb26c0 1 -- 10.20.193.70:0/965303166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa09810f230 msgr2=0x7fa09811d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09ebb26c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa09810f230 0x7fa09811d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09ebb26c0 1 -- 10.20.193.70:0/965303166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa088009590 con 0x7fa098122cb0 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa09ebb26c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa098122cb0 0x7fa098123150 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa094006ea0 tx=0x7fa09400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa07f7fe6c0 1 -- 10.20.193.70:0/965303166 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa094003a30 con 0x7fa098122cb0 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa07f7fe6c0 1 -- 10.20.193.70:0/965303166 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa0940054f0 con 0x7fa098122cb0 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa098163ea0 con 0x7fa098122cb0 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa07f7fe6c0 1 -- 10.20.193.70:0/965303166 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa09400dcd0 con 0x7fa098122cb0 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.793+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa098164330 con 0x7fa098122cb0 2026-02-13T03:46:14.798 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.794+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa098110500 con 0x7fa098122cb0 2026-02-13T03:46:14.799 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.795+0000 7fa07f7fe6c0 1 -- 10.20.193.70:0/965303166 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7fa094005030 con 0x7fa098122cb0 2026-02-13T03:46:14.800 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.796+0000 7fa07f7fe6c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa0740b5690 0x7fa0740d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:14.800 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.796+0000 7fa09e3b16c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa0740b5690 0x7fa0740d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:14.800 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.796+0000 7fa07f7fe6c0 1 -- 10.20.193.70:0/965303166 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fa0940e4d90 con 0x7fa098122cb0 2026-02-13T03:46:14.800 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.796+0000 7fa09e3b16c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa0740b5690 0x7fa0740d5b40 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0880092e0 tx=0x7fa088005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:14.800 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.796+0000 7fa07f7fe6c0 1 -- 10.20.193.70:0/965303166 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa0940a76b0 con 0x7fa098122cb0 2026-02-13T03:46:14.917 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.915+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa09811e500 con 0x7fa098122cb0 2026-02-13T03:46:14.917 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.916+0000 7fa07f7fe6c0 1 -- 10.20.193.70:0/965303166 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa0940aa860 con 0x7fa098122cb0 2026-02-13T03:46:14.917 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:14.917 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:14.918 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa0740b5690 msgr2=0x7fa0740d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:14.919 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa0740b5690 0x7fa0740d5b40 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0880092e0 tx=0x7fa088005c00 comp rx=0 tx=0).stop 2026-02-13T03:46:14.919 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa098122cb0 msgr2=0x7fa098123150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:14.919 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa098122cb0 0x7fa098123150 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa094006ea0 tx=0x7fa09400cca0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.919 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 shutdown_connections 2026-02-13T03:46:14.919 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa0740b5690 0x7fa0740d5b40 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.919 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa098122cb0 0x7fa098123150 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.919 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa098115440 0x7fa09811d8f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.919 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 --2- 10.20.193.70:0/965303166 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa09810f230 0x7fa09811d3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:14.919 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 >> 10.20.193.70:0/965303166 conn(0x7fa0980ecb30 msgr2=0x7fa09810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:14.920 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 shutdown_connections 2026-02-13T03:46:14.920 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:14.917+0000 7fa0a06406c0 1 -- 10.20.193.70:0/965303166 wait complete. 2026-02-13T03:46:15.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:14 trial070 ceph-mon[24757]: pgmap v213: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1023 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:15.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:14 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/965303166' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:15.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:14 trial177 ceph-mon[27082]: pgmap v213: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1023 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:15.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:14 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/965303166' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:15.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:14 trial127 ceph-mon[26439]: pgmap v213: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1023 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:15.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:14 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/965303166' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:17.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:16 trial070 ceph-mon[24757]: pgmap v214: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 866 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:17.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:16 trial177 ceph-mon[27082]: pgmap v214: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 866 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:17.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:16 trial127 ceph-mon[26439]: pgmap v214: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 866 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T03:46:17.963 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:18.084 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:18.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.202+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/3097122506 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff51410f230 msgr2=0x7ff51410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:18.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.202+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/3097122506 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff51410f230 0x7ff51410f600 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=13795155302117708742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5040099a0 tx=0x7ff50402ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:18.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.202+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/3097122506 shutdown_connections 2026-02-13T03:46:18.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.202+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/3097122506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff514115440 0x7ff514175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.206 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.202+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/3097122506 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff51410fc20 0x7ff514114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.202+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/3097122506 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff51410f230 0x7ff51410f600 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=13795155302117708742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.202+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/3097122506 >> 10.20.193.70:0/3097122506 conn(0x7ff5140ecb30 msgr2=0x7ff51410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.202+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/3097122506 shutdown_connections 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.202+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/3097122506 wait complete. 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51ba0d6c0 1 Processor -- start 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51ba0d6c0 1 -- start start 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51ba0d6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff51410f230 0x7ff51411d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51ba0d6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff514115440 0x7ff51411d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51ba0d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff514122c80 0x7ff514123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:18.207 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51ba0d6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff514123690 con 0x7ff514122c80 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51ba0d6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff514123800 con 0x7ff514115440 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51ba0d6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff5141239c0 con 0x7ff51410f230 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff519f7f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff514122c80 0x7ff514123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff519f7f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff514122c80 0x7ff514123120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:58518/0 (socket says 10.20.193.70:58518) 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff519f7f6c0 1 -- 10.20.193.70:0/1528922865 learned_addr learned my addr 10.20.193.70:0/1528922865 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51977e6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff51410f230 0x7ff51411d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff518f7d6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff514115440 0x7ff51411d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff519f7f6c0 1 -- 10.20.193.70:0/1528922865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff51410f230 msgr2=0x7ff51411d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff519f7f6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff51410f230 0x7ff51411d380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff519f7f6c0 1 -- 10.20.193.70:0/1528922865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff514115440 msgr2=0x7ff51411d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff519f7f6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff514115440 0x7ff51411d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff519f7f6c0 1 -- 10.20.193.70:0/1528922865 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff504009590 con 0x7ff514122c80 2026-02-13T03:46:18.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff518f7d6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff514115440 0x7ff51411d8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:46:18.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff519f7f6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff514122c80 0x7ff514123120 secure :-1 s=READY pgs=342 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff510006ea0 tx=0x7ff51000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:18.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff5027fc6c0 1 -- 10.20.193.70:0/1528922865 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff510003a30 con 0x7ff514122c80 2026-02-13T03:46:18.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff5027fc6c0 1 -- 10.20.193.70:0/1528922865 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff5100054f0 con 0x7ff514122c80 2026-02-13T03:46:18.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff514163e70 con 0x7ff514122c80 2026-02-13T03:46:18.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.203+0000 7ff5027fc6c0 1 -- 10.20.193.70:0/1528922865 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff51000dcd0 con 0x7ff514122c80 2026-02-13T03:46:18.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.204+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff514164350 con 0x7ff514122c80 2026-02-13T03:46:18.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.204+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff514110500 con 0x7ff514122c80 2026-02-13T03:46:18.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.205+0000 7ff5027fc6c0 1 -- 10.20.193.70:0/1528922865 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7ff510005030 con 0x7ff514122c80 2026-02-13T03:46:18.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.206+0000 7ff5027fc6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff4f00b5710 0x7ff4f00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:18.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.206+0000 7ff5027fc6c0 1 -- 10.20.193.70:0/1528922865 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7ff5100e4bd0 con 0x7ff514122c80 2026-02-13T03:46:18.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.206+0000 7ff51977e6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff4f00b5710 0x7ff4f00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:18.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.206+0000 7ff51977e6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff4f00b5710 0x7ff4f00d5bc0 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff504005b40 tx=0x7ff5040023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:18.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.207+0000 7ff5027fc6c0 1 -- 10.20.193.70:0/1528922865 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff5100a74f0 con 0x7ff514122c80 2026-02-13T03:46:18.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.324+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff51410f600 con 0x7ff514122c80 2026-02-13T03:46:18.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.324+0000 7ff5027fc6c0 1 -- 10.20.193.70:0/1528922865 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff51000de60 con 0x7ff514122c80 2026-02-13T03:46:18.326 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:18.326 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:18.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff4f00b5710 msgr2=0x7ff4f00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:18.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff4f00b5710 0x7ff4f00d5bc0 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff504005b40 tx=0x7ff5040023a0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff514122c80 msgr2=0x7ff514123120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:18.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff514122c80 0x7ff514123120 secure :-1 s=READY pgs=342 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff510006ea0 tx=0x7ff51000cca0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 shutdown_connections 2026-02-13T03:46:18.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff4f00b5710 0x7ff4f00d5bc0 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff514122c80 0x7ff514123120 unknown :-1 s=CLOSED pgs=342 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.328 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff514115440 0x7ff51411d8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.328 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 --2- 10.20.193.70:0/1528922865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff51410f230 0x7ff51411d380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:18.328 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 >> 10.20.193.70:0/1528922865 conn(0x7ff5140ecb30 msgr2=0x7ff51410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:18.328 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 shutdown_connections 2026-02-13T03:46:18.328 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:18.325+0000 7ff51ba0d6c0 1 -- 10.20.193.70:0/1528922865 wait complete. 2026-02-13T03:46:19.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:18 trial070 ceph-mon[24757]: pgmap v215: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:19.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:18 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1528922865' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:19.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:18 trial177 ceph-mon[27082]: pgmap v215: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:19.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1528922865' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:19.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:18 trial127 ceph-mon[26439]: pgmap v215: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:19.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:18 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1528922865' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:21.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:20 trial070 ceph-mon[24757]: pgmap v216: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:21.368 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:21.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:20 trial177 ceph-mon[27082]: pgmap v216: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:21.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:20 trial127 ceph-mon[26439]: pgmap v216: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:21.488 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:21.613 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/3118062227 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c10f230 msgr2=0x7ff89c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:21.613 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/3118062227 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c10f230 0x7ff89c10f600 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=7642686755331233991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8900099a0 tx=0x7ff89002ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/3118062227 shutdown_connections 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/3118062227 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff89c115440 0x7ff89c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/3118062227 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff89c10fc20 0x7ff89c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/3118062227 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c10f230 0x7ff89c10f600 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=7642686755331233991 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/3118062227 >> 10.20.193.70:0/3118062227 conn(0x7ff89c0ecb30 msgr2=0x7ff89c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/3118062227 shutdown_connections 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/3118062227 wait complete. 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.610+0000 7ff8a0fed6c0 1 Processor -- start 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 -- start start 2026-02-13T03:46:21.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff89c10f230 0x7ff89c11d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c115440 0x7ff89c11d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff89c122c20 0x7ff89c1230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c123630 con 0x7ff89c115440 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c1237a0 con 0x7ff89c10f230 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c123960 con 0x7ff89c122c20 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff899d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c115440 0x7ff89c11d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff899d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c115440 0x7ff89c11d860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:58530/0 (socket says 10.20.193.70:58530) 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff899d746c0 1 -- 10.20.193.70:0/263852511 learned_addr learned my addr 10.20.193.70:0/263852511 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff899d746c0 1 -- 10.20.193.70:0/263852511 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff89c122c20 msgr2=0x7ff89c1230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff899d746c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff89c122c20 0x7ff89c1230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff899d746c0 1 -- 10.20.193.70:0/263852511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff89c10f230 msgr2=0x7ff89c11d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:21.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff899d746c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff89c10f230 0x7ff89c11d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff899d746c0 1 -- 10.20.193.70:0/263852511 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff890009590 con 0x7ff89c115440 2026-02-13T03:46:21.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff899d746c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c115440 0x7ff89c11d860 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff884005dc0 tx=0x7ff88400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:21.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8837fe6c0 1 -- 10.20.193.70:0/263852511 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff884004250 con 0x7ff89c115440 2026-02-13T03:46:21.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8837fe6c0 1 -- 10.20.193.70:0/263852511 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff884009070 con 0x7ff89c115440 2026-02-13T03:46:21.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89c163e10 con 0x7ff89c115440 2026-02-13T03:46:21.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8837fe6c0 1 -- 10.20.193.70:0/263852511 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff88400cd50 con 0x7ff89c115440 2026-02-13T03:46:21.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89c1642a0 con 0x7ff89c115440 2026-02-13T03:46:21.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.611+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89c110500 con 0x7ff89c115440 2026-02-13T03:46:21.617 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.613+0000 7ff8837fe6c0 1 -- 10.20.193.70:0/263852511 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7ff8840028c0 con 0x7ff89c115440 2026-02-13T03:46:21.617 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.614+0000 7ff8837fe6c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8740b5690 0x7ff8740d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:21.618 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.614+0000 7ff89a5756c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8740b5690 0x7ff8740d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:21.618 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.614+0000 7ff8837fe6c0 1 -- 10.20.193.70:0/263852511 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7ff8840e3bf0 con 0x7ff89c115440 2026-02-13T03:46:21.618 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.614+0000 7ff8837fe6c0 1 -- 10.20.193.70:0/263852511 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff8840a6550 con 0x7ff89c115440 2026-02-13T03:46:21.618 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.614+0000 7ff89a5756c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8740b5690 0x7ff8740d5b40 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff890005b40 tx=0x7ff890005c60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:21.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.731+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff89c10f600 con 0x7ff89c115440 2026-02-13T03:46:21.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.732+0000 7ff8837fe6c0 1 -- 10.20.193.70:0/263852511 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff8840a9700 con 0x7ff89c115440 2026-02-13T03:46:21.734 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:21.734 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:21.735 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.732+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8740b5690 msgr2=0x7ff8740d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:21.735 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.732+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8740b5690 0x7ff8740d5b40 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff890005b40 tx=0x7ff890005c60 comp rx=0 tx=0).stop 2026-02-13T03:46:21.735 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.732+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c115440 msgr2=0x7ff89c11d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:21.735 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.732+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c115440 0x7ff89c11d860 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff884005dc0 tx=0x7ff88400bbb0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.735 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.733+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 shutdown_connections 2026-02-13T03:46:21.735 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.733+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8740b5690 0x7ff8740d5b40 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.735 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.733+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff89c122c20 0x7ff89c1230c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.735 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.733+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff89c115440 0x7ff89c11d860 unknown :-1 s=CLOSED pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.736 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.733+0000 7ff8a0fed6c0 1 --2- 10.20.193.70:0/263852511 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff89c10f230 0x7ff89c11d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:21.736 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.733+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 >> 10.20.193.70:0/263852511 conn(0x7ff89c0ecb30 msgr2=0x7ff89c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:21.736 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.733+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 shutdown_connections 2026-02-13T03:46:21.736 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:21.733+0000 7ff8a0fed6c0 1 -- 10.20.193.70:0/263852511 wait complete. 2026-02-13T03:46:22.252 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:21 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/263852511' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:22.252 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:21 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:46:22.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:21 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/263852511' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:22.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:21 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:46:22.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:21 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/263852511' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:22.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:21 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:46:23.263 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: pgmap v217: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:23.263 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.263 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.263 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.264 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.264 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.264 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.264 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:46:23.264 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:46:23.264 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.264 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:46:23.264 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:46:23.264 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:23 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:46:23.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: pgmap v217: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:46:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:46:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:46:23.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:46:23.299 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:23 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:46:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: pgmap v217: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:46:23.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:46:23.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:46:23.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:46:23.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:46:23.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:23 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:46:24.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:24 trial070 ceph-mon[24757]: pgmap v218: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 915 B/s rd, 1 op/s 2026-02-13T03:46:24.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:24 trial177 ceph-mon[27082]: pgmap v218: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 915 B/s rd, 1 op/s 2026-02-13T03:46:24.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:24 trial127 ceph-mon[26439]: pgmap v218: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 915 B/s rd, 1 op/s 2026-02-13T03:46:24.778 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:24.897 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.012+0000 7f2324fc46c0 1 -- 10.20.193.70:0/1283981763 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2320115410 msgr2=0x7f2320175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.012+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/1283981763 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2320115410 0x7f2320175db0 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=6888769440651537023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f231000aa70 tx=0x7f231002fde0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.012+0000 7f2324fc46c0 1 -- 10.20.193.70:0/1283981763 shutdown_connections 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.012+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/1283981763 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2320115410 0x7f2320175db0 unknown :-1 s=CLOSED pgs=345 gs=1 cs=0 l=1 c_cookie=6888769440651537023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.012+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/1283981763 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f232010fbf0 0x7f2320114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.012+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/1283981763 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f232010f200 0x7f232010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.012+0000 7f2324fc46c0 1 -- 10.20.193.70:0/1283981763 >> 10.20.193.70:0/1283981763 conn(0x7f23200ecb00 msgr2=0x7f232010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.012+0000 7f2324fc46c0 1 -- 10.20.193.70:0/1283981763 shutdown_connections 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.012+0000 7f2324fc46c0 1 -- 10.20.193.70:0/1283981763 wait complete. 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f2324fc46c0 1 Processor -- start 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f2324fc46c0 1 -- start start 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f2324fc46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f232010f200 0x7f232011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f2324fc46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2320115410 0x7f232011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f2324fc46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2320122b50 0x7f2320122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f2324fc46c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2320123560 con 0x7f232010f200 2026-02-13T03:46:25.014 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f2324fc46c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f23201236d0 con 0x7f2320122b50 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f2324fc46c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2320123890 con 0x7f2320115410 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231e5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f232010f200 0x7f232011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231e5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f232010f200 0x7f232011d250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:58538/0 (socket says 10.20.193.70:58538) 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231e5756c0 1 -- 10.20.193.70:0/2508494061 learned_addr learned my addr 10.20.193.70:0/2508494061 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231ed766c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2320122b50 0x7f2320122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231dd746c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2320115410 0x7f232011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231e5756c0 1 -- 10.20.193.70:0/2508494061 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2320115410 msgr2=0x7f232011d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231e5756c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2320115410 0x7f232011d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231e5756c0 1 -- 10.20.193.70:0/2508494061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2320122b50 msgr2=0x7f2320122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231e5756c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2320122b50 0x7f2320122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231e5756c0 1 -- 10.20.193.70:0/2508494061 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231000a660 con 0x7f232010f200 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f231e5756c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f232010f200 0x7f232011d250 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f231400b6c0 tx=0x7f231400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.013+0000 7f23077fe6c0 1 -- 10.20.193.70:0/2508494061 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f23140044a0 con 0x7f232010f200 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.014+0000 7f23077fe6c0 1 -- 10.20.193.70:0/2508494061 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2314009030 con 0x7f232010f200 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.014+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2320163d40 con 0x7f232010f200 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.014+0000 7f23077fe6c0 1 -- 10.20.193.70:0/2508494061 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f231400cbe0 con 0x7f232010f200 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.014+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2320164220 con 0x7f232010f200 2026-02-13T03:46:25.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.014+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23201104d0 con 0x7f232010f200 2026-02-13T03:46:25.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.015+0000 7f23077fe6c0 1 -- 10.20.193.70:0/2508494061 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f2314005080 con 0x7f232010f200 2026-02-13T03:46:25.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.016+0000 7f23077fe6c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f22f80b5710 0x7f22f80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:25.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.016+0000 7f231dd746c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f22f80b5710 0x7f22f80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:25.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.016+0000 7f23077fe6c0 1 -- 10.20.193.70:0/2508494061 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f23140e3a00 con 0x7f232010f200 2026-02-13T03:46:25.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.016+0000 7f231dd746c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f22f80b5710 0x7f22f80d5bc0 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2308005980 tx=0x7f2308005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:25.017 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.016+0000 7f23077fe6c0 1 -- 10.20.193.70:0/2508494061 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f23140a6360 con 0x7f232010f200 2026-02-13T03:46:25.139 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.138+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f232010f5d0 con 0x7f232010f200 2026-02-13T03:46:25.140 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:25 trial070 ceph-mon[24757]: pgmap v219: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 522 B/s rd, 1 op/s 2026-02-13T03:46:25.140 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.138+0000 7f23077fe6c0 1 -- 10.20.193.70:0/2508494061 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f23140a9510 con 0x7f232010f200 2026-02-13T03:46:25.141 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:25.141 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:25.141 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f22f80b5710 msgr2=0x7f22f80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f22f80b5710 0x7f22f80d5bc0 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2308005980 tx=0x7f2308005910 comp rx=0 tx=0).stop 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f232010f200 msgr2=0x7f232011d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f232010f200 0x7f232011d250 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f231400b6c0 tx=0x7f231400bb90 comp rx=0 tx=0).stop 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 shutdown_connections 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f22f80b5710 0x7f22f80d5bc0 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2320122b50 0x7f2320122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2320115410 0x7f232011d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 --2- 10.20.193.70:0/2508494061 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f232010f200 0x7f232011d250 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 >> 10.20.193.70:0/2508494061 conn(0x7f23200ecb00 msgr2=0x7f232010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 shutdown_connections 2026-02-13T03:46:25.142 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:25.140+0000 7f2324fc46c0 1 -- 10.20.193.70:0/2508494061 wait complete. 2026-02-13T03:46:25.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:25 trial177 ceph-mon[27082]: pgmap v219: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 522 B/s rd, 1 op/s 2026-02-13T03:46:25.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:25 trial127 ceph-mon[26439]: pgmap v219: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 522 B/s rd, 1 op/s 2026-02-13T03:46:26.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:26 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2508494061' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:26.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:26 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2508494061' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:26.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:26 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2508494061' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:27.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:27 trial070 ceph-mon[24757]: pgmap v220: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:27.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:27 trial177 ceph-mon[27082]: pgmap v220: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:27.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:27 trial127 ceph-mon[26439]: pgmap v220: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:28.184 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:28.302 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:28.426 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.422+0000 7febca2b86c0 1 -- 10.20.193.70:0/3346071027 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc410fc20 msgr2=0x7febc4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:28.426 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.422+0000 7febca2b86c0 1 --2- 10.20.193.70:0/3346071027 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc410fc20 0x7febc4114c60 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=13114792070555745101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febb40099a0 tx=0x7febb402ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:28.426 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.422+0000 7febca2b86c0 1 -- 10.20.193.70:0/3346071027 shutdown_connections 2026-02-13T03:46:28.426 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.422+0000 7febca2b86c0 1 --2- 10.20.193.70:0/3346071027 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7febc4115440 0x7febc4175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.426 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.422+0000 7febca2b86c0 1 --2- 10.20.193.70:0/3346071027 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc410fc20 0x7febc4114c60 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=13114792070555745101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.426 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.422+0000 7febca2b86c0 1 --2- 10.20.193.70:0/3346071027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc410f230 0x7febc410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.426 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.422+0000 7febca2b86c0 1 -- 10.20.193.70:0/3346071027 >> 10.20.193.70:0/3346071027 conn(0x7febc40ecb30 msgr2=0x7febc410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.422+0000 7febca2b86c0 1 -- 10.20.193.70:0/3346071027 shutdown_connections 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.422+0000 7febca2b86c0 1 -- 10.20.193.70:0/3346071027 wait complete. 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 Processor -- start 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 -- start start 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc410f230 0x7febc40f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7febc4115440 0x7febc4175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc40f5300 0x7febc40fa5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7febc40f59f0 con 0x7febc40f5300 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7febc40fab10 con 0x7febc4115440 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7febc40facd0 con 0x7febc410f230 2026-02-13T03:46:28.427 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc882e6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc40f5300 0x7febc40fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc882e6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc40f5300 0x7febc40fa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:54284/0 (socket says 10.20.193.70:54284) 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc882e6c0 1 -- 10.20.193.70:0/283773181 learned_addr learned my addr 10.20.193.70:0/283773181 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc3fff6c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc410f230 0x7febc40f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc37fe6c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7febc4115440 0x7febc4175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc882e6c0 1 -- 10.20.193.70:0/283773181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc410f230 msgr2=0x7febc40f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc882e6c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc410f230 0x7febc40f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc882e6c0 1 -- 10.20.193.70:0/283773181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7febc4115440 msgr2=0x7febc4175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc882e6c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7febc4115440 0x7febc4175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc882e6c0 1 -- 10.20.193.70:0/283773181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb4009590 con 0x7febc40f5300 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc37fe6c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7febc4115440 0x7febc4175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc882e6c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc40f5300 0x7febc40fa5d0 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febb8006ea0 tx=0x7febb800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:28.428 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc17fa6c0 1 -- 10.20.193.70:0/283773181 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7febb8003a30 con 0x7febc40f5300 2026-02-13T03:46:28.429 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc40fafb0 con 0x7febc40f5300 2026-02-13T03:46:28.429 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc17fa6c0 1 -- 10.20.193.70:0/283773181 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7febb80054f0 con 0x7febc40f5300 2026-02-13T03:46:28.429 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febc17fa6c0 1 -- 10.20.193.70:0/283773181 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7febb800dcd0 con 0x7febc40f5300 2026-02-13T03:46:28.429 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.423+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc40fb740 con 0x7febc40f5300 2026-02-13T03:46:28.429 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.424+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc40fb490 con 0x7febc40f5300 2026-02-13T03:46:28.430 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.425+0000 7febc17fa6c0 1 -- 10.20.193.70:0/283773181 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7febb8003b90 con 0x7febc40f5300 2026-02-13T03:46:28.430 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.426+0000 7febc17fa6c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feb980b5690 0x7feb980d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:28.430 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.426+0000 7febc17fa6c0 1 -- 10.20.193.70:0/283773181 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7febb80e4bb0 con 0x7febc40f5300 2026-02-13T03:46:28.430 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.426+0000 7febc3fff6c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feb980b5690 0x7feb980d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:28.430 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.426+0000 7febc17fa6c0 1 -- 10.20.193.70:0/283773181 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7febb80aa4e0 con 0x7febc40f5300 2026-02-13T03:46:28.430 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.426+0000 7febc3fff6c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feb980b5690 0x7feb980d5b40 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febb0004750 tx=0x7febb0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:28.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.543+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7febc4110500 con 0x7febc40f5300 2026-02-13T03:46:28.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.544+0000 7febc17fa6c0 1 -- 10.20.193.70:0/283773181 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7febb80aa6c0 con 0x7febc40f5300 2026-02-13T03:46:28.545 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:28.545 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:28.546 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feb980b5690 msgr2=0x7feb980d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:28.546 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feb980b5690 0x7feb980d5b40 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febb0004750 tx=0x7febb0009260 comp rx=0 tx=0).stop 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc40f5300 msgr2=0x7febc40fa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc40f5300 0x7febc40fa5d0 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febb8006ea0 tx=0x7febb800cca0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 shutdown_connections 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feb980b5690 0x7feb980d5b40 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7febc40f5300 0x7febc40fa5d0 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7febc4115440 0x7febc4175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 --2- 10.20.193.70:0/283773181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc410f230 0x7febc40f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 >> 10.20.193.70:0/283773181 conn(0x7febc40ecb30 msgr2=0x7febc4113da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 shutdown_connections 2026-02-13T03:46:28.547 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:28.545+0000 7febca2b86c0 1 -- 10.20.193.70:0/283773181 wait complete. 2026-02-13T03:46:29.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:29 trial070 ceph-mon[24757]: pgmap v221: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:29 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/283773181' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:29.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:29 trial177 ceph-mon[27082]: pgmap v221: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:29.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:29 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/283773181' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:29.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:29 trial127 ceph-mon[26439]: pgmap v221: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:29.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:29 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/283773181' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:31.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:31 trial070 ceph-mon[24757]: pgmap v222: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:31.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:31 trial177 ceph-mon[27082]: pgmap v222: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:31.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:31 trial127 ceph-mon[26439]: pgmap v222: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:31.588 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:31.704 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.819+0000 7f73d20b86c0 1 -- 10.20.193.70:0/3894975589 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc10fbf0 msgr2=0x7f73cc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.819+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/3894975589 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc10fbf0 0x7f73cc114c30 secure :-1 s=READY pgs=349 gs=2 cs=0 l=1 c_cookie=322363996722647378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73bc0099a0 tx=0x7f73bc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.819+0000 7f73d20b86c0 1 -- 10.20.193.70:0/3894975589 shutdown_connections 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.819+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/3894975589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73cc115410 0x7f73cc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.819+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/3894975589 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc10fbf0 0x7f73cc114c30 unknown :-1 s=CLOSED pgs=349 gs=2 cs=0 l=1 c_cookie=322363996722647378 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.819+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/3894975589 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73cc10f200 0x7f73cc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.819+0000 7f73d20b86c0 1 -- 10.20.193.70:0/3894975589 >> 10.20.193.70:0/3894975589 conn(0x7f73cc0ecb00 msgr2=0x7f73cc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.819+0000 7f73d20b86c0 1 -- 10.20.193.70:0/3894975589 shutdown_connections 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.819+0000 7f73d20b86c0 1 -- 10.20.193.70:0/3894975589 wait complete. 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 Processor -- start 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 -- start start 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73cc10f200 0x7f73cc0f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73cc115410 0x7f73cc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc0f52c0 0x7f73cc0fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc0f59b0 con 0x7f73cc0f52c0 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc0faad0 con 0x7f73cc10f200 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc0fac90 con 0x7f73cc115410 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73cbfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc0f52c0 0x7f73cc0fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:31.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73cbfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc0f52c0 0x7f73cc0fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:54306/0 (socket says 10.20.193.70:54306) 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73cbfff6c0 1 -- 10.20.193.70:0/2817672701 learned_addr learned my addr 10.20.193.70:0/2817672701 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73caffd6c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73cc115410 0x7f73cc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73cbfff6c0 1 -- 10.20.193.70:0/2817672701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73cc115410 msgr2=0x7f73cc175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73cbfff6c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73cc115410 0x7f73cc175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73cbfff6c0 1 -- 10.20.193.70:0/2817672701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73cc10f200 msgr2=0x7f73cc0f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73cbfff6c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73cc10f200 0x7f73cc0f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73cbfff6c0 1 -- 10.20.193.70:0/2817672701 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc009590 con 0x7f73cc0f52c0 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73cbfff6c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc0f52c0 0x7f73cc0fa590 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73c0006ea0 tx=0x7f73c000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73c8ff96c0 1 -- 10.20.193.70:0/2817672701 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73c0003a30 con 0x7f73cc0f52c0 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73c8ff96c0 1 -- 10.20.193.70:0/2817672701 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f73c00054f0 con 0x7f73cc0f52c0 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc0faf70 con 0x7f73cc0f52c0 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73c8ff96c0 1 -- 10.20.193.70:0/2817672701 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73c000dcd0 con 0x7f73cc0f52c0 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.820+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc0fb400 con 0x7f73cc0f52c0 2026-02-13T03:46:31.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.821+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73cc1104d0 con 0x7f73cc0f52c0 2026-02-13T03:46:31.823 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.822+0000 7f73c8ff96c0 1 -- 10.20.193.70:0/2817672701 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 12) ==== 157117+0+0 (secure 0 0 0) 0x7f73c0003b90 con 0x7f73cc0f52c0 2026-02-13T03:46:31.823 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.823+0000 7f73c8ff96c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f73a00b5690 0x7f73a00d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:31.823 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.823+0000 7f73cb7fe6c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f73a00b5690 0x7f73a00d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:31.824 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.823+0000 7f73c8ff96c0 1 -- 10.20.193.70:0/2817672701 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f73c00e4b50 con 0x7f73cc0f52c0 2026-02-13T03:46:31.824 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.823+0000 7f73c8ff96c0 1 -- 10.20.193.70:0/2817672701 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f73c00aa620 con 0x7f73cc0f52c0 2026-02-13T03:46:31.824 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.823+0000 7f73cb7fe6c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f73a00b5690 0x7f73a00d5b40 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73b8005980 tx=0x7f73b8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:31.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.941+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f73cc0fb400 con 0x7f73cc0f52c0 2026-02-13T03:46:31.942 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.941+0000 7f73c8ff96c0 1 -- 10.20.193.70:0/2817672701 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f73c00aa800 con 0x7f73cc0f52c0 2026-02-13T03:46:31.942 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:31.942 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f73a00b5690 msgr2=0x7f73a00d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f73a00b5690 0x7f73a00d5b40 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73b8005980 tx=0x7f73b8005910 comp rx=0 tx=0).stop 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc0f52c0 msgr2=0x7f73cc0fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc0f52c0 0x7f73cc0fa590 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73c0006ea0 tx=0x7f73c000cca0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 shutdown_connections 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f73a00b5690 0x7f73a00d5b40 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f73cc0f52c0 0x7f73cc0fa590 unknown :-1 s=CLOSED pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73cc115410 0x7f73cc175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 --2- 10.20.193.70:0/2817672701 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f73cc10f200 0x7f73cc0f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 >> 10.20.193.70:0/2817672701 conn(0x7f73cc0ecb00 msgr2=0x7f73cc113d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 shutdown_connections 2026-02-13T03:46:31.943 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:31.942+0000 7f73d20b86c0 1 -- 10.20.193.70:0/2817672701 wait complete. 2026-02-13T03:46:32.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:32 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2817672701' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:32.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:32 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2817672701' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:32.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:32 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2817672701' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:33.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:33 trial070 ceph-mon[24757]: pgmap v223: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:33.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:33 trial177 ceph-mon[27082]: pgmap v223: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:33.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:33 trial127 ceph-mon[26439]: pgmap v223: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:46:34.983 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:35.105 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.218+0000 7f748cf286c0 1 -- 10.20.193.70:0/1835000128 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f748810f200 msgr2=0x7f748810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.218+0000 7f748cf286c0 1 --2- 10.20.193.70:0/1835000128 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f748810f200 0x7f748810f5d0 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=9151576486023244493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f747c0099a0 tx=0x7f747c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 -- 10.20.193.70:0/1835000128 shutdown_connections 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 --2- 10.20.193.70:0/1835000128 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7488115410 0x7f7488175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 --2- 10.20.193.70:0/1835000128 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f748810fbf0 0x7f7488114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 --2- 10.20.193.70:0/1835000128 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f748810f200 0x7f748810f5d0 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=9151576486023244493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 -- 10.20.193.70:0/1835000128 >> 10.20.193.70:0/1835000128 conn(0x7f74880ecb00 msgr2=0x7f748810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 -- 10.20.193.70:0/1835000128 shutdown_connections 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 -- 10.20.193.70:0/1835000128 wait complete. 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 Processor -- start 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 -- start start 2026-02-13T03:46:35.220 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f748810f200 0x7f748811d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7488115410 0x7f748811d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7488122c30 0x7f74881230d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7488123640 con 0x7f7488115410 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f74881237b0 con 0x7f748810f200 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f748cf286c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7488123970 con 0x7f7488122c30 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7485d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7488115410 0x7f748811d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7485d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7488115410 0x7f748811d870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:54324/0 (socket says 10.20.193.70:54324) 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7485d746c0 1 -- 10.20.193.70:0/3031678430 learned_addr learned my addr 10.20.193.70:0/3031678430 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7486d766c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7488122c30 0x7f74881230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f74865756c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f748810f200 0x7f748811d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7485d746c0 1 -- 10.20.193.70:0/3031678430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7488122c30 msgr2=0x7f74881230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7485d746c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7488122c30 0x7f74881230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7485d746c0 1 -- 10.20.193.70:0/3031678430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f748810f200 msgr2=0x7f748811d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7485d746c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f748810f200 0x7f748811d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7485d746c0 1 -- 10.20.193.70:0/3031678430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747c009590 con 0x7f7488115410 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.219+0000 7f7485d746c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7488115410 0x7f748811d870 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7470005dc0 tx=0x7f747000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.220+0000 7f746f7fe6c0 1 -- 10.20.193.70:0/3031678430 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7470004250 con 0x7f7488115410 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.220+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7488163e20 con 0x7f7488115410 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.220+0000 7f746f7fe6c0 1 -- 10.20.193.70:0/3031678430 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7470009070 con 0x7f7488115410 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.220+0000 7f746f7fe6c0 1 -- 10.20.193.70:0/3031678430 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f747000cd50 con 0x7f7488115410 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.220+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74881642b0 con 0x7f7488115410 2026-02-13T03:46:35.221 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.220+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74881104d0 con 0x7f7488115410 2026-02-13T03:46:35.222 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.221+0000 7f746f7fe6c0 1 -- 10.20.193.70:0/3031678430 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f74700028c0 con 0x7f7488115410 2026-02-13T03:46:35.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.222+0000 7f746f7fe6c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74600b5600 0x7f74600d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:35.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.222+0000 7f74865756c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74600b5600 0x7f74600d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:35.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.222+0000 7f746f7fe6c0 1 -- 10.20.193.70:0/3031678430 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f74700e3b20 con 0x7f7488115410 2026-02-13T03:46:35.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.222+0000 7f746f7fe6c0 1 -- 10.20.193.70:0/3031678430 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f747011c600 con 0x7f7488115410 2026-02-13T03:46:35.223 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.222+0000 7f74865756c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74600b5600 0x7f74600d5ab0 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f747c0023e0 tx=0x7f747c005c60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:35.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:35 trial070 ceph-mon[24757]: pgmap v224: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 964 B/s rd, 1 op/s 2026-02-13T03:46:35.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.342+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f748810f5d0 con 0x7f7488115410 2026-02-13T03:46:35.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.342+0000 7f746f7fe6c0 1 -- 10.20.193.70:0/3031678430 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f74700a65e0 con 0x7f7488115410 2026-02-13T03:46:35.343 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:35.343 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:35.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.343+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74600b5600 msgr2=0x7f74600d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:35.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.343+0000 7f748cf286c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74600b5600 0x7f74600d5ab0 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f747c0023e0 tx=0x7f747c005c60 comp rx=0 tx=0).stop 2026-02-13T03:46:35.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.343+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7488115410 msgr2=0x7f748811d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:35.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.343+0000 7f748cf286c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7488115410 0x7f748811d870 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7470005dc0 tx=0x7f747000bbb0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.344+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 shutdown_connections 2026-02-13T03:46:35.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.344+0000 7f748cf286c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f74600b5600 0x7f74600d5ab0 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.344 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.344+0000 7f748cf286c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7488122c30 0x7f74881230d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.344+0000 7f748cf286c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7488115410 0x7f748811d870 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.344+0000 7f748cf286c0 1 --2- 10.20.193.70:0/3031678430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f748810f200 0x7f748811d330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:35.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.344+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 >> 10.20.193.70:0/3031678430 conn(0x7f74880ecb00 msgr2=0x7f748810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:35.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.344+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 shutdown_connections 2026-02-13T03:46:35.345 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:35.344+0000 7f748cf286c0 1 -- 10.20.193.70:0/3031678430 wait complete. 2026-02-13T03:46:35.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:35 trial177 ceph-mon[27082]: pgmap v224: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 964 B/s rd, 1 op/s 2026-02-13T03:46:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:35 trial127 ceph-mon[26439]: pgmap v224: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 964 B/s rd, 1 op/s 2026-02-13T03:46:36.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:36 trial070 ceph-mon[24757]: mgrmap e13: x(active, since 3m), standbys: z, y 2026-02-13T03:46:36.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3031678430' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:36 trial177 ceph-mon[27082]: mgrmap e13: x(active, since 3m), standbys: z, y 2026-02-13T03:46:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3031678430' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:36 trial127 ceph-mon[26439]: mgrmap e13: x(active, since 3m), standbys: z, y 2026-02-13T03:46:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3031678430' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:37.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:37 trial070 ceph-mon[24757]: pgmap v225: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:37.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:37 trial177 ceph-mon[27082]: pgmap v225: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:37.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:37 trial127 ceph-mon[26439]: pgmap v225: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:38.405 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:38.525 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:38.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/1224252547 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410d970 msgr2=0x7fd2a41129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:38.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/1224252547 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410d970 0x7fd2a41129b0 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=7849868976835043726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2940099a0 tx=0x7fd29402ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:38.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/1224252547 shutdown_connections 2026-02-13T03:46:38.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/1224252547 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2a4113190 0x7fd2a4173b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/1224252547 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410d970 0x7fd2a41129b0 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=7849868976835043726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/1224252547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2a410cf80 0x7fd2a410d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/1224252547 >> 10.20.193.70:0/1224252547 conn(0x7fd2a40ea880 msgr2=0x7fd2a410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/1224252547 shutdown_connections 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/1224252547 wait complete. 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 Processor -- start 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 -- start start 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410cf80 0x7fd2a411b070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2a4113190 0x7fd2a411b5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2a4120970 0x7fd2a4120e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4121380 con 0x7fd2a410cf80 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41214f0 con 0x7fd2a4120970 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2aa71d6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a41216b0 con 0x7fd2a4113190 2026-02-13T03:46:38.651 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2a3fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410cf80 0x7fd2a411b070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2a3fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410cf80 0x7fd2a411b070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:59126/0 (socket says 10.20.193.70:59126) 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2a3fff6c0 1 -- 10.20.193.70:0/3581942256 learned_addr learned my addr 10.20.193.70:0/3581942256 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.647+0000 7fd2a8c8f6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2a4120970 0x7fd2a4120e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a37fe6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2a4113190 0x7fd2a411b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a3fff6c0 1 -- 10.20.193.70:0/3581942256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2a4113190 msgr2=0x7fd2a411b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a3fff6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2a4113190 0x7fd2a411b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a3fff6c0 1 -- 10.20.193.70:0/3581942256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2a4120970 msgr2=0x7fd2a4120e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a3fff6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2a4120970 0x7fd2a4120e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a3fff6c0 1 -- 10.20.193.70:0/3581942256 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd294009590 con 0x7fd2a410cf80 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a3fff6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410cf80 0x7fd2a411b070 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd290005dc0 tx=0x7fd29000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a17fa6c0 1 -- 10.20.193.70:0/3581942256 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd290004250 con 0x7fd2a410cf80 2026-02-13T03:46:38.652 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a4161b60 con 0x7fd2a410cf80 2026-02-13T03:46:38.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a17fa6c0 1 -- 10.20.193.70:0/3581942256 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd290009070 con 0x7fd2a410cf80 2026-02-13T03:46:38.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2a17fa6c0 1 -- 10.20.193.70:0/3581942256 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd29000cd70 con 0x7fd2a410cf80 2026-02-13T03:46:38.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a4161ff0 con 0x7fd2a410cf80 2026-02-13T03:46:38.653 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.648+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a410e250 con 0x7fd2a410cf80 2026-02-13T03:46:38.654 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.650+0000 7fd2a17fa6c0 1 -- 10.20.193.70:0/3581942256 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fd2900028c0 con 0x7fd2a410cf80 2026-02-13T03:46:38.654 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.650+0000 7fd2a17fa6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2780b5600 0x7fd2780d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:38.654 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.650+0000 7fd2a17fa6c0 1 -- 10.20.193.70:0/3581942256 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fd2900e3b30 con 0x7fd2a410cf80 2026-02-13T03:46:38.654 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.650+0000 7fd2a37fe6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2780b5600 0x7fd2780d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:38.654 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.650+0000 7fd2a17fa6c0 1 -- 10.20.193.70:0/3581942256 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd2900a65f0 con 0x7fd2a410cf80 2026-02-13T03:46:38.654 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.651+0000 7fd2a37fe6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2780b5600 0x7fd2780d5ab0 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd294005b40 tx=0x7fd2940092a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:38.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.768+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd2a411c1c0 con 0x7fd2a410cf80 2026-02-13T03:46:38.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.768+0000 7fd2a17fa6c0 1 -- 10.20.193.70:0/3581942256 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd2900a97a0 con 0x7fd2a410cf80 2026-02-13T03:46:38.770 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:38.770 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:38.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2780b5600 msgr2=0x7fd2780d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:38.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2780b5600 0x7fd2780d5ab0 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd294005b40 tx=0x7fd2940092a0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410cf80 msgr2=0x7fd2a411b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:38.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410cf80 0x7fd2a411b070 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd290005dc0 tx=0x7fd29000bbb0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.771 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 shutdown_connections 2026-02-13T03:46:38.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2780b5600 0x7fd2780d5ab0 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd2a4120970 0x7fd2a4120e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2a4113190 0x7fd2a411b5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 --2- 10.20.193.70:0/3581942256 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd2a410cf80 0x7fd2a411b070 unknown :-1 s=CLOSED pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:38.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 >> 10.20.193.70:0/3581942256 conn(0x7fd2a40ea880 msgr2=0x7fd2a410ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:38.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 shutdown_connections 2026-02-13T03:46:38.772 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:38.769+0000 7fd2aa71d6c0 1 -- 10.20.193.70:0/3581942256 wait complete. 2026-02-13T03:46:39.275 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:39 trial127 ceph-mon[26439]: pgmap v226: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:39.276 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:39 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3581942256' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:39.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:39 trial070 ceph-mon[24757]: pgmap v226: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:39.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:39 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3581942256' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:39.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:39 trial177 ceph-mon[27082]: pgmap v226: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:39.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:39 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3581942256' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:41.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:41 trial070 ceph-mon[24757]: pgmap v227: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:41.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:41 trial177 ceph-mon[27082]: pgmap v227: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:41.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:41 trial127 ceph-mon[26439]: pgmap v227: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:41.811 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:41.931 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:42.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/2847497485 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 msgr2=0x7f2e00175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:42.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/2847497485 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 0x7f2e00175db0 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=17139885548459730101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dfc00aa70 tx=0x7f2dfc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/2847497485 shutdown_connections 2026-02-13T03:46:42.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/2847497485 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 0x7f2e00175db0 unknown :-1 s=CLOSED pgs=355 gs=1 cs=0 l=1 c_cookie=17139885548459730101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/2847497485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0010fbf0 0x7f2e00114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/2847497485 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e0010f200 0x7f2e0010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.056 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/2847497485 >> 10.20.193.70:0/2847497485 conn(0x7f2e000ecb00 msgr2=0x7f2e0010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/2847497485 shutdown_connections 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/2847497485 wait complete. 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 Processor -- start 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 -- start start 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0010f200 0x7f2e0011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.053+0000 7f2e06eb16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 0x7f2e0011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e06eb16c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e00122b50 0x7f2e00122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e06eb16c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2e00123560 con 0x7f2e00115410 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e06eb16c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2e001236d0 con 0x7f2e00122b50 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e06eb16c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e00123890 con 0x7f2e0010f200 2026-02-13T03:46:42.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df7fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 0x7f2e0011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df7fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 0x7f2e0011d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:59144/0 (socket says 10.20.193.70:59144) 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df7fff6c0 1 -- 10.20.193.70:0/4043912080 learned_addr learned my addr 10.20.193.70:0/4043912080 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e04c226c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0010f200 0x7f2e0011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e054236c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e00122b50 0x7f2e00122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df7fff6c0 1 -- 10.20.193.70:0/4043912080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0010f200 msgr2=0x7f2e0011d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df7fff6c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0010f200 0x7f2e0011d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df7fff6c0 1 -- 10.20.193.70:0/4043912080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e00122b50 msgr2=0x7f2e00122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df7fff6c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e00122b50 0x7f2e00122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df7fff6c0 1 -- 10.20.193.70:0/4043912080 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc00a660 con 0x7f2e00115410 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e04c226c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0010f200 0x7f2e0011d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df7fff6c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 0x7f2e0011d790 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2de800b750 tx=0x7f2de800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:42.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df5ffb6c0 1 -- 10.20.193.70:0/4043912080 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2de8004a80 con 0x7f2e00115410 2026-02-13T03:46:42.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df5ffb6c0 1 -- 10.20.193.70:0/4043912080 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2de8009030 con 0x7f2e00115410 2026-02-13T03:46:42.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e00163d40 con 0x7f2e00115410 2026-02-13T03:46:42.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2df5ffb6c0 1 -- 10.20.193.70:0/4043912080 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2de800cd00 con 0x7f2e00115410 2026-02-13T03:46:42.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e001641d0 con 0x7f2e00115410 2026-02-13T03:46:42.059 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.054+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e001104d0 con 0x7f2e00115410 2026-02-13T03:46:42.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.056+0000 7f2df5ffb6c0 1 -- 10.20.193.70:0/4043912080 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f2de8005020 con 0x7f2e00115410 2026-02-13T03:46:42.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.056+0000 7f2df5ffb6c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2ddc0b5680 0x7f2ddc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:42.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.057+0000 7f2e04c226c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2ddc0b5680 0x7f2ddc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:42.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.057+0000 7f2df5ffb6c0 1 -- 10.20.193.70:0/4043912080 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f2de80e3a30 con 0x7f2e00115410 2026-02-13T03:46:42.060 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.057+0000 7f2df5ffb6c0 1 -- 10.20.193.70:0/4043912080 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2de80a64f0 con 0x7f2e00115410 2026-02-13T03:46:42.061 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.057+0000 7f2e04c226c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2ddc0b5680 0x7f2ddc0d5b30 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df0005fd0 tx=0x7f2df00092c0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:42.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.174+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2e0010f5d0 con 0x7f2e00115410 2026-02-13T03:46:42.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.174+0000 7f2df5ffb6c0 1 -- 10.20.193.70:0/4043912080 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2de80a96a0 con 0x7f2e00115410 2026-02-13T03:46:42.176 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:42.176 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:42.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2ddc0b5680 msgr2=0x7f2ddc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:42.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2ddc0b5680 0x7f2ddc0d5b30 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2df0005fd0 tx=0x7f2df00092c0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 msgr2=0x7f2e0011d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:42.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 0x7f2e0011d790 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2de800b750 tx=0x7f2de800bc20 comp rx=0 tx=0).stop 2026-02-13T03:46:42.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 shutdown_connections 2026-02-13T03:46:42.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2ddc0b5680 0x7f2ddc0d5b30 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2e00122b50 0x7f2e00122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2e00115410 0x7f2e0011d790 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 --2- 10.20.193.70:0/4043912080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0010f200 0x7f2e0011d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:42.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 >> 10.20.193.70:0/4043912080 conn(0x7f2e000ecb00 msgr2=0x7f2e0010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:42.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 shutdown_connections 2026-02-13T03:46:42.178 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:42.176+0000 7f2e06eb16c0 1 -- 10.20.193.70:0/4043912080 wait complete. 2026-02-13T03:46:43.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:43 trial070 ceph-mon[24757]: pgmap v228: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:43.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:43 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4043912080' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:43.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:43 trial177 ceph-mon[27082]: pgmap v228: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:43.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:43 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4043912080' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:43.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:43 trial127 ceph-mon[26439]: pgmap v228: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:43.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:43 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4043912080' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:45.219 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:45.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:45 trial070 ceph-mon[24757]: pgmap v229: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:45.342 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:45.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:45 trial177 ceph-mon[27082]: pgmap v229: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:45.458 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.455+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3603157678 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab4410cfb0 msgr2=0x7fab4410d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:45.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.455+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3603157678 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab4410cfb0 0x7fab4410d380 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=1482540636724759312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab340099a0 tx=0x7fab3402ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:45.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.455+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3603157678 shutdown_connections 2026-02-13T03:46:45.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.455+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3603157678 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab441131c0 0x7fab44173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.455+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3603157678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fab4410d9a0 0x7fab441129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.455+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3603157678 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab4410cfb0 0x7fab4410d380 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=1482540636724759312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.455+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3603157678 >> 10.20.193.70:0/3603157678 conn(0x7fab440ea8b0 msgr2=0x7fab4410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:45.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.455+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3603157678 shutdown_connections 2026-02-13T03:46:45.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.455+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3603157678 wait complete. 2026-02-13T03:46:45.459 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab4ad686c0 1 Processor -- start 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab4ad686c0 1 -- start start 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab4ad686c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab4410cfb0 0x7fab44060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab4ad686c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab441131c0 0x7fab44060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab4ad686c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fab44061180 0x7fab44163340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab4ad686c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fab44163880 con 0x7fab441131c0 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab4ad686c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fab441639f0 con 0x7fab4410cfb0 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab4ad686c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fab44163bb0 con 0x7fab44061180 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab3bfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab441131c0 0x7fab44060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab3bfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab441131c0 0x7fab44060c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:59164/0 (socket says 10.20.193.70:59164) 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab3bfff6c0 1 -- 10.20.193.70:0/3588586596 learned_addr learned my addr 10.20.193.70:0/3588586596 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:45.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab48add6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab4410cfb0 0x7fab44060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab492de6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fab44061180 0x7fab44163340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab3bfff6c0 1 -- 10.20.193.70:0/3588586596 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fab44061180 msgr2=0x7fab44163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab3bfff6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fab44061180 0x7fab44163340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab3bfff6c0 1 -- 10.20.193.70:0/3588586596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab4410cfb0 msgr2=0x7fab44060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab3bfff6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab4410cfb0 0x7fab44060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab3bfff6c0 1 -- 10.20.193.70:0/3588586596 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab34009590 con 0x7fab441131c0 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab48add6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab4410cfb0 0x7fab44060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab492de6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fab44061180 0x7fab44163340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab3bfff6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab441131c0 0x7fab44060c40 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab2c005dc0 tx=0x7fab2c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab39ffb6c0 1 -- 10.20.193.70:0/3588586596 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab2c004250 con 0x7fab441131c0 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab39ffb6c0 1 -- 10.20.193.70:0/3588586596 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fab2c009070 con 0x7fab441131c0 2026-02-13T03:46:45.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.456+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab44163e90 con 0x7fab441131c0 2026-02-13T03:46:45.462 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.457+0000 7fab39ffb6c0 1 -- 10.20.193.70:0/3588586596 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab2c00cd50 con 0x7fab441131c0 2026-02-13T03:46:45.462 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.457+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab441643c0 con 0x7fab441131c0 2026-02-13T03:46:45.462 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.457+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4410e280 con 0x7fab441131c0 2026-02-13T03:46:45.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.458+0000 7fab39ffb6c0 1 -- 10.20.193.70:0/3588586596 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fab2c0028c0 con 0x7fab441131c0 2026-02-13T03:46:45.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.459+0000 7fab39ffb6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fab200b5680 0x7fab200d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:45.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.459+0000 7fab39ffb6c0 1 -- 10.20.193.70:0/3588586596 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fab2c0e39c0 con 0x7fab441131c0 2026-02-13T03:46:45.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.459+0000 7fab48add6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fab200b5680 0x7fab200d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:45.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.460+0000 7fab48add6c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fab200b5680 0x7fab200d5b30 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab34005b40 tx=0x7fab34005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:45.463 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.460+0000 7fab39ffb6c0 1 -- 10.20.193.70:0/3588586596 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fab2c0a6480 con 0x7fab441131c0 2026-02-13T03:46:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:45 trial127 ceph-mon[26439]: pgmap v229: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:45.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.579+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fab44061a00 con 0x7fab441131c0 2026-02-13T03:46:45.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.579+0000 7fab39ffb6c0 1 -- 10.20.193.70:0/3588586596 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fab2c0a9630 con 0x7fab441131c0 2026-02-13T03:46:45.580 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:45.581 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:45.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fab200b5680 msgr2=0x7fab200d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fab200b5680 0x7fab200d5b30 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab34005b40 tx=0x7fab34005c00 comp rx=0 tx=0).stop 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab441131c0 msgr2=0x7fab44060c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab441131c0 0x7fab44060c40 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab2c005dc0 tx=0x7fab2c00bbb0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 shutdown_connections 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fab200b5680 0x7fab200d5b30 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fab44061180 0x7fab44163340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fab441131c0 0x7fab44060c40 unknown :-1 s=CLOSED pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 --2- 10.20.193.70:0/3588586596 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fab4410cfb0 0x7fab44060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 >> 10.20.193.70:0/3588586596 conn(0x7fab440ea8b0 msgr2=0x7fab4410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 shutdown_connections 2026-02-13T03:46:45.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:45.580+0000 7fab4ad686c0 1 -- 10.20.193.70:0/3588586596 wait complete. 2026-02-13T03:46:46.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:46 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3588586596' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:46.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:46 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3588586596' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:46.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:46 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3588586596' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:47.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:47 trial070 ceph-mon[24757]: pgmap v230: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:47.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:47 trial177 ceph-mon[27082]: pgmap v230: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:47.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:47 trial127 ceph-mon[26439]: pgmap v230: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2026-02-13T03:46:48.625 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:48.748 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:48.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.869+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/2758461193 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b0115410 msgr2=0x7fe0b0175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:48.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.869+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/2758461193 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b0115410 0x7fe0b0175db0 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=15680009086052212626 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0a400aa70 tx=0x7fe0a402fde0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.869+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/2758461193 shutdown_connections 2026-02-13T03:46:48.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.869+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/2758461193 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b0115410 0x7fe0b0175db0 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=15680009086052212626 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.869+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/2758461193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b010fbf0 0x7fe0b0114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.869+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/2758461193 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0b010f200 0x7fe0b010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.869+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/2758461193 >> 10.20.193.70:0/2758461193 conn(0x7fe0b00ecb00 msgr2=0x7fe0b010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:48.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.869+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/2758461193 shutdown_connections 2026-02-13T03:46:48.873 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.869+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/2758461193 wait complete. 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 Processor -- start 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 -- start start 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b010f200 0x7fe0b011d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b0115410 0x7fe0b011d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0b0122b00 0x7fe0b0122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0123510 con 0x7fe0b010f200 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0123680 con 0x7fe0b0122b00 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b0123840 con 0x7fe0b0115410 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0affff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b010f200 0x7fe0b011d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0affff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b010f200 0x7fe0b011d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:45938/0 (socket says 10.20.193.70:45938) 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0affff6c0 1 -- 10.20.193.70:0/4221155715 learned_addr learned my addr 10.20.193.70:0/4221155715 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:48.874 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0af7fe6c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b0115410 0x7fe0b011d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0affff6c0 1 -- 10.20.193.70:0/4221155715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b0115410 msgr2=0x7fe0b011d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0affff6c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b0115410 0x7fe0b011d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0affff6c0 1 -- 10.20.193.70:0/4221155715 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0b0122b00 msgr2=0x7fe0b0122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0affff6c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0b0122b00 0x7fe0b0122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0affff6c0 1 -- 10.20.193.70:0/4221155715 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a400a660 con 0x7fe0b010f200 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0affff6c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b010f200 0x7fe0b011d200 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe09c00b710 tx=0x7fe09c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0ad7fa6c0 1 -- 10.20.193.70:0/4221155715 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe09c004250 con 0x7fe0b010f200 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0ad7fa6c0 1 -- 10.20.193.70:0/4221155715 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe09c002d80 con 0x7fe0b010f200 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b0163cf0 con 0x7fe0b010f200 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0ad7fa6c0 1 -- 10.20.193.70:0/4221155715 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe09c00cdc0 con 0x7fe0b010f200 2026-02-13T03:46:48.875 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.870+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b0164180 con 0x7fe0b010f200 2026-02-13T03:46:48.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.871+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b01104d0 con 0x7fe0b010f200 2026-02-13T03:46:48.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.872+0000 7fe0ad7fa6c0 1 -- 10.20.193.70:0/4221155715 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe09c0028c0 con 0x7fe0b010f200 2026-02-13T03:46:48.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.873+0000 7fe0ad7fa6c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe0840b5600 0x7fe0840d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:48.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.873+0000 7fe0ad7fa6c0 1 -- 10.20.193.70:0/4221155715 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fe09c0e3bf0 con 0x7fe0b010f200 2026-02-13T03:46:48.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.873+0000 7fe0af7fe6c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe0840b5600 0x7fe0840d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:48.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.873+0000 7fe0ad7fa6c0 1 -- 10.20.193.70:0/4221155715 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe09c0a66b0 con 0x7fe0b010f200 2026-02-13T03:46:48.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.873+0000 7fe0af7fe6c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe0840b5600 0x7fe0840d5ab0 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b0123b90 tx=0x7fe0a0005ee0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:48.992 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.990+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe0b010f5d0 con 0x7fe0b010f200 2026-02-13T03:46:48.992 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.991+0000 7fe0ad7fa6c0 1 -- 10.20.193.70:0/4221155715 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe09c0a9860 con 0x7fe0b010f200 2026-02-13T03:46:48.992 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:48.992 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:48.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe0840b5600 msgr2=0x7fe0840d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:48.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe0840b5600 0x7fe0840d5ab0 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b0123b90 tx=0x7fe0a0005ee0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b010f200 msgr2=0x7fe0b011d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:48.993 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b010f200 0x7fe0b011d200 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe09c00b710 tx=0x7fe09c00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 shutdown_connections 2026-02-13T03:46:48.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe0840b5600 0x7fe0840d5ab0 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0b0122b00 0x7fe0b0122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b0115410 0x7fe0b011d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 --2- 10.20.193.70:0/4221155715 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe0b010f200 0x7fe0b011d200 unknown :-1 s=CLOSED pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:48.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 >> 10.20.193.70:0/4221155715 conn(0x7fe0b00ecb00 msgr2=0x7fe0b010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:48.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 shutdown_connections 2026-02-13T03:46:48.994 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:48.992+0000 7fe0b62f36c0 1 -- 10.20.193.70:0/4221155715 wait complete. 2026-02-13T03:46:49.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:49 trial070 ceph-mon[24757]: pgmap v231: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2026-02-13T03:46:49.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:49 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4221155715' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:49.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:49 trial177 ceph-mon[27082]: pgmap v231: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2026-02-13T03:46:49.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:49 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4221155715' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:49.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:49 trial127 ceph-mon[26439]: pgmap v231: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2026-02-13T03:46:49.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:49 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4221155715' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:51.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:51 trial070 ceph-mon[24757]: pgmap v232: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:51.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:51 trial177 ceph-mon[27082]: pgmap v232: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:51.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:51 trial127 ceph-mon[26439]: pgmap v232: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:52.034 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:52.151 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/506692505 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 msgr2=0x7fc7bc10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/506692505 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 0x7fc7bc10f5d0 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=16665493799121095295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7a80099a0 tx=0x7fc7a802ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/506692505 shutdown_connections 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/506692505 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7bc115410 0x7fc7bc175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/506692505 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc7bc10fbf0 0x7fc7bc114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/506692505 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 0x7fc7bc10f5d0 unknown :-1 s=CLOSED pgs=361 gs=1 cs=0 l=1 c_cookie=16665493799121095295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/506692505 >> 10.20.193.70:0/506692505 conn(0x7fc7bc0ecb00 msgr2=0x7fc7bc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/506692505 shutdown_connections 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/506692505 wait complete. 2026-02-13T03:46:52.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.263+0000 7fc7c1b346c0 1 Processor -- start 2026-02-13T03:46:52.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 -- start start 2026-02-13T03:46:52.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 0x7fc7bc11d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:52.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7bc115410 0x7fc7bc11d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:52.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc7bc122c50 0x7fc7bc1230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:52.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc123660 con 0x7fc7bc10f200 2026-02-13T03:46:52.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc1237d0 con 0x7fc7bc122c50 2026-02-13T03:46:52.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc123990 con 0x7fc7bc115410 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7bb7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 0x7fc7bc11d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7bb7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 0x7fc7bc11d350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:45958/0 (socket says 10.20.193.70:45958) 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7bb7fe6c0 1 -- 10.20.193.70:0/4258723884 learned_addr learned my addr 10.20.193.70:0/4258723884 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7baffd6c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7bc115410 0x7fc7bc11d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7bb7fe6c0 1 -- 10.20.193.70:0/4258723884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7bc115410 msgr2=0x7fc7bc11d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7bb7fe6c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7bc115410 0x7fc7bc11d890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7bb7fe6c0 1 -- 10.20.193.70:0/4258723884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc7bc122c50 msgr2=0x7fc7bc1230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7bb7fe6c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc7bc122c50 0x7fc7bc1230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7bb7fe6c0 1 -- 10.20.193.70:0/4258723884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a8009590 con 0x7fc7bc10f200 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7bb7fe6c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 0x7fc7bc11d350 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7a802f230 tx=0x7fc7a802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7b8ff96c0 1 -- 10.20.193.70:0/4258723884 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7a8002ba0 con 0x7fc7bc10f200 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7b8ff96c0 1 -- 10.20.193.70:0/4258723884 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc7a8002d00 con 0x7fc7bc10f200 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7bc163de0 con 0x7fc7bc10f200 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7b8ff96c0 1 -- 10.20.193.70:0/4258723884 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7a80372f0 con 0x7fc7bc10f200 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7bc164210 con 0x7fc7bc10f200 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.264+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7bc1104d0 con 0x7fc7bc10f200 2026-02-13T03:46:52.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.266+0000 7fc7b8ff96c0 1 -- 10.20.193.70:0/4258723884 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fc7a80078d0 con 0x7fc7bc10f200 2026-02-13T03:46:52.267 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.266+0000 7fc7b8ff96c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7900b5600 0x7fc7900d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:52.267 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.267+0000 7fc7baffd6c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7900b5600 0x7fc7900d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:52.267 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.267+0000 7fc7b8ff96c0 1 -- 10.20.193.70:0/4258723884 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fc7a8107c20 con 0x7fc7bc10f200 2026-02-13T03:46:52.267 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.267+0000 7fc7b8ff96c0 1 -- 10.20.193.70:0/4258723884 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc7a80ca6a0 con 0x7fc7bc10f200 2026-02-13T03:46:52.268 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.267+0000 7fc7baffd6c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7900b5600 0x7fc7900d5ab0 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7ac005980 tx=0x7fc7ac005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:52.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.388+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc7bc11e4a0 con 0x7fc7bc10f200 2026-02-13T03:46:52.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.388+0000 7fc7b8ff96c0 1 -- 10.20.193.70:0/4258723884 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc7a80cd850 con 0x7fc7bc10f200 2026-02-13T03:46:52.389 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:52.389 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7900b5600 msgr2=0x7fc7900d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7900b5600 0x7fc7900d5ab0 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7ac005980 tx=0x7fc7ac005910 comp rx=0 tx=0).stop 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 msgr2=0x7fc7bc11d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 0x7fc7bc11d350 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7a802f230 tx=0x7fc7a802fd40 comp rx=0 tx=0).stop 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 shutdown_connections 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7900b5600 0x7fc7900d5ab0 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc7bc122c50 0x7fc7bc1230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc7bc115410 0x7fc7bc11d890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 --2- 10.20.193.70:0/4258723884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc7bc10f200 0x7fc7bc11d350 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 >> 10.20.193.70:0/4258723884 conn(0x7fc7bc0ecb00 msgr2=0x7fc7bc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 shutdown_connections 2026-02-13T03:46:52.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:52.390+0000 7fc7c1b346c0 1 -- 10.20.193.70:0/4258723884 wait complete. 2026-02-13T03:46:53.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:53 trial070 ceph-mon[24757]: pgmap v233: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:53.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:53 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4258723884' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:53.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:53 trial177 ceph-mon[27082]: pgmap v233: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:53.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:53 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4258723884' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:53.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:53 trial127 ceph-mon[26439]: pgmap v233: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:53.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:53 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4258723884' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:55.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:55 trial070 ceph-mon[24757]: pgmap v234: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:55.433 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:55.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:55 trial177 ceph-mon[27082]: pgmap v234: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:55.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:55 trial127 ceph-mon[26439]: pgmap v234: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:55.550 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:55.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.668+0000 7f38cfe436c0 1 -- 10.20.193.70:0/3103319848 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 msgr2=0x7f38c810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:55.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.668+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/3103319848 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 0x7f38c810f600 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=16151743395922628157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38b80099a0 tx=0x7f38b802ed20 comp rx=0 tx=0).stop 2026-02-13T03:46:55.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.668+0000 7f38cfe436c0 1 -- 10.20.193.70:0/3103319848 shutdown_connections 2026-02-13T03:46:55.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.668+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/3103319848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38c8115440 0x7f38c8175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:55.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.668+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/3103319848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f38c810fc20 0x7f38c8114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:55.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.668+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/3103319848 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 0x7f38c810f600 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=16151743395922628157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:55.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.668+0000 7f38cfe436c0 1 -- 10.20.193.70:0/3103319848 >> 10.20.193.70:0/3103319848 conn(0x7f38c80ecb30 msgr2=0x7f38c810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:55.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.668+0000 7f38cfe436c0 1 -- 10.20.193.70:0/3103319848 shutdown_connections 2026-02-13T03:46:55.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.668+0000 7f38cfe436c0 1 -- 10.20.193.70:0/3103319848 wait complete. 2026-02-13T03:46:55.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cfe436c0 1 Processor -- start 2026-02-13T03:46:55.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cfe436c0 1 -- start start 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cfe436c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 0x7f38c811d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cfe436c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f38c8115440 0x7f38c811d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cfe436c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38c8122c80 0x7f38c8123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cfe436c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f38c8123690 con 0x7f38c810f230 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cfe436c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f38c8123800 con 0x7f38c8122c80 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cfe436c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f38c81239c0 con 0x7f38c8115440 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cdbb46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 0x7f38c811d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cdbb46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 0x7f38c811d380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:45976/0 (socket says 10.20.193.70:45976) 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cdbb46c0 1 -- 10.20.193.70:0/2475504839 learned_addr learned my addr 10.20.193.70:0/2475504839 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38ce3b56c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38c8122c80 0x7f38c8123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cd3b36c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f38c8115440 0x7f38c811d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cdbb46c0 1 -- 10.20.193.70:0/2475504839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f38c8115440 msgr2=0x7f38c811d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cdbb46c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f38c8115440 0x7f38c811d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cdbb46c0 1 -- 10.20.193.70:0/2475504839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38c8122c80 msgr2=0x7f38c8123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cdbb46c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38c8122c80 0x7f38c8123120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cdbb46c0 1 -- 10.20.193.70:0/2475504839 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b8009590 con 0x7f38c810f230 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cd3b36c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f38c8115440 0x7f38c811d8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cdbb46c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 0x7f38c811d380 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38b802f230 tx=0x7f38b802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38b6ffd6c0 1 -- 10.20.193.70:0/2475504839 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38b8002ba0 con 0x7f38c810f230 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c8163e10 con 0x7f38c810f230 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.669+0000 7f38b6ffd6c0 1 -- 10.20.193.70:0/2475504839 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f38b8002d00 con 0x7f38c810f230 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.670+0000 7f38b6ffd6c0 1 -- 10.20.193.70:0/2475504839 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38b80372f0 con 0x7f38c810f230 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.670+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c8164290 con 0x7f38c810f230 2026-02-13T03:46:55.671 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.670+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c8110500 con 0x7f38c810f230 2026-02-13T03:46:55.672 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.671+0000 7f38b6ffd6c0 1 -- 10.20.193.70:0/2475504839 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f38b80078d0 con 0x7f38c810f230 2026-02-13T03:46:55.672 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.672+0000 7f38b6ffd6c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f38a40b5680 0x7f38a40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:55.673 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.672+0000 7f38cd3b36c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f38a40b5680 0x7f38a40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:55.673 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.672+0000 7f38b6ffd6c0 1 -- 10.20.193.70:0/2475504839 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f38b8107ad0 con 0x7f38c810f230 2026-02-13T03:46:55.673 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.672+0000 7f38b6ffd6c0 1 -- 10.20.193.70:0/2475504839 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f38b80ca590 con 0x7f38c810f230 2026-02-13T03:46:55.673 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.672+0000 7f38cd3b36c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f38a40b5680 0x7f38a40d5b30 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38c8123d10 tx=0x7f38bc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:55.790 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.789+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f38c810f600 con 0x7f38c810f230 2026-02-13T03:46:55.790 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.790+0000 7f38b6ffd6c0 1 -- 10.20.193.70:0/2475504839 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f38b80cd740 con 0x7f38c810f230 2026-02-13T03:46:55.790 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:55.790 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f38a40b5680 msgr2=0x7f38a40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f38a40b5680 0x7f38a40d5b30 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38c8123d10 tx=0x7f38bc009260 comp rx=0 tx=0).stop 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 msgr2=0x7f38c811d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 0x7f38c811d380 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38b802f230 tx=0x7f38b802fd40 comp rx=0 tx=0).stop 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 shutdown_connections 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f38a40b5680 0x7f38a40d5b30 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f38c8122c80 0x7f38c8123120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f38c8115440 0x7f38c811d8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 --2- 10.20.193.70:0/2475504839 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f38c810f230 0x7f38c811d380 unknown :-1 s=CLOSED pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 >> 10.20.193.70:0/2475504839 conn(0x7f38c80ecb30 msgr2=0x7f38c810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 shutdown_connections 2026-02-13T03:46:55.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:55.791+0000 7f38cfe436c0 1 -- 10.20.193.70:0/2475504839 wait complete. 2026-02-13T03:46:56.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:56 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2475504839' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:56.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:56 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2475504839' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:56.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:56 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2475504839' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:46:57.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:57 trial177 ceph-mon[27082]: pgmap v235: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:57.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:57 trial127 ceph-mon[26439]: pgmap v235: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:57.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:57 trial070 ceph-mon[24757]: pgmap v235: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:46:58.833 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:46:58.952 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:46:59.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.076+0000 7f27a30906c0 1 -- 10.20.193.70:0/4016335251 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c115440 msgr2=0x7f279c175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:59.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.076+0000 7f27a30906c0 1 --2- 10.20.193.70:0/4016335251 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c115440 0x7f279c175de0 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=15384285841775890147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f279800aa70 tx=0x7f279802fde0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.076+0000 7f27a30906c0 1 -- 10.20.193.70:0/4016335251 shutdown_connections 2026-02-13T03:46:59.078 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.076+0000 7f27a30906c0 1 --2- 10.20.193.70:0/4016335251 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c115440 0x7f279c175de0 unknown :-1 s=CLOSED pgs=365 gs=1 cs=0 l=1 c_cookie=15384285841775890147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.076+0000 7f27a30906c0 1 --2- 10.20.193.70:0/4016335251 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f279c10fc20 0x7f279c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.076+0000 7f27a30906c0 1 --2- 10.20.193.70:0/4016335251 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f279c10f230 0x7f279c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.076+0000 7f27a30906c0 1 -- 10.20.193.70:0/4016335251 >> 10.20.193.70:0/4016335251 conn(0x7f279c0ecb30 msgr2=0x7f279c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.076+0000 7f27a30906c0 1 -- 10.20.193.70:0/4016335251 shutdown_connections 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.076+0000 7f27a30906c0 1 -- 10.20.193.70:0/4016335251 wait complete. 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 Processor -- start 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 -- start start 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c10f230 0x7f279c11d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f279c115440 0x7f279c11d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f279c122ae0 0x7f279c122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1234f0 con 0x7f279c10f230 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f279c123660 con 0x7f279c115440 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f279c123820 con 0x7f279c122ae0 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a0e056c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c10f230 0x7f279c11d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a0e056c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c10f230 0x7f279c11d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:60872/0 (socket says 10.20.193.70:60872) 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a0e056c0 1 -- 10.20.193.70:0/2287740773 learned_addr learned my addr 10.20.193.70:0/2287740773 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f2793fff6c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f279c115440 0x7f279c11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a0e056c0 1 -- 10.20.193.70:0/2287740773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f279c122ae0 msgr2=0x7f279c122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a0e056c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f279c122ae0 0x7f279c122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a0e056c0 1 -- 10.20.193.70:0/2287740773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f279c115440 msgr2=0x7f279c11d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a0e056c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f279c115440 0x7f279c11d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a0e056c0 1 -- 10.20.193.70:0/2287740773 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279800a660 con 0x7f279c10f230 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a0e056c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c10f230 0x7f279c11d1e0 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f278c00b710 tx=0x7f278c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f2791ffb6c0 1 -- 10.20.193.70:0/2287740773 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f278c004250 con 0x7f279c10f230 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f2791ffb6c0 1 -- 10.20.193.70:0/2287740773 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f278c002d80 con 0x7f279c10f230 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f2791ffb6c0 1 -- 10.20.193.70:0/2287740773 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f278c00cdc0 con 0x7f279c10f230 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c163cd0 con 0x7f279c10f230 2026-02-13T03:46:59.079 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.077+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c1641b0 con 0x7f279c10f230 2026-02-13T03:46:59.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.078+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279c110500 con 0x7f279c10f230 2026-02-13T03:46:59.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.079+0000 7f2791ffb6c0 1 -- 10.20.193.70:0/2287740773 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f278c0028c0 con 0x7f279c10f230 2026-02-13T03:46:59.080 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.080+0000 7f2791ffb6c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f27780b5680 0x7f27780d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:46:59.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.080+0000 7f2793fff6c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f27780b5680 0x7f27780d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:46:59.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.080+0000 7f2791ffb6c0 1 -- 10.20.193.70:0/2287740773 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f278c0e3b90 con 0x7f279c10f230 2026-02-13T03:46:59.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.080+0000 7f2793fff6c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f27780b5680 0x7f27780d5b30 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2784005980 tx=0x7f2784005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:46:59.081 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.080+0000 7f2791ffb6c0 1 -- 10.20.193.70:0/2287740773 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f278c0a6610 con 0x7f279c10f230 2026-02-13T03:46:59.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.199+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f279c10f600 con 0x7f279c10f230 2026-02-13T03:46:59.200 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:46:59 trial070 ceph-mon[24757]: pgmap v236: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:59.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.199+0000 7f2791ffb6c0 1 -- 10.20.193.70:0/2287740773 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f278c0a97c0 con 0x7f279c10f230 2026-02-13T03:46:59.200 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:46:59.200 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:46:59.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f27780b5680 msgr2=0x7f27780d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:59.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f27780b5680 0x7f27780d5b30 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2784005980 tx=0x7f2784005910 comp rx=0 tx=0).stop 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c10f230 msgr2=0x7f279c11d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c10f230 0x7f279c11d1e0 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f278c00b710 tx=0x7f278c00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 shutdown_connections 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f27780b5680 0x7f27780d5b30 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f279c122ae0 0x7f279c122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f279c115440 0x7f279c11d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 --2- 10.20.193.70:0/2287740773 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f279c10f230 0x7f279c11d1e0 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 >> 10.20.193.70:0/2287740773 conn(0x7f279c0ecb30 msgr2=0x7f279c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 shutdown_connections 2026-02-13T03:46:59.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:46:59.201+0000 7f27a30906c0 1 -- 10.20.193.70:0/2287740773 wait complete. 2026-02-13T03:46:59.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:46:59 trial177 ceph-mon[27082]: pgmap v236: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:46:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:46:59 trial127 ceph-mon[26439]: pgmap v236: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:00.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:00 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2287740773' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:00.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:00 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2287740773' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:00.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:00 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2287740773' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:01.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:01 trial177 ceph-mon[27082]: pgmap v237: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:01.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:01 trial127 ceph-mon[26439]: pgmap v237: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:01.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:01 trial070 ceph-mon[24757]: pgmap v237: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:02.242 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:02.364 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:02.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.480+0000 7f151a0c46c0 1 -- 10.20.193.70:0/4242503363 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 msgr2=0x7f151410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.480+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/4242503363 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 0x7f151410f5d0 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=9760343351715592640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15000099a0 tx=0x7f150002ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.480+0000 7f151a0c46c0 1 -- 10.20.193.70:0/4242503363 shutdown_connections 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.480+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/4242503363 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1514115410 0x7f1514175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.480+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/4242503363 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f151410fbf0 0x7f1514114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.480+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/4242503363 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 0x7f151410f5d0 unknown :-1 s=CLOSED pgs=367 gs=1 cs=0 l=1 c_cookie=9760343351715592640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.480+0000 7f151a0c46c0 1 -- 10.20.193.70:0/4242503363 >> 10.20.193.70:0/4242503363 conn(0x7f15140ecb00 msgr2=0x7f151410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 -- 10.20.193.70:0/4242503363 shutdown_connections 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 -- 10.20.193.70:0/4242503363 wait complete. 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 Processor -- start 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 -- start start 2026-02-13T03:47:02.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 0x7f151411d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1514115410 0x7f151411d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1514122c90 0x7f1514123130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15141236a0 con 0x7f151410f200 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1514123810 con 0x7f1514115410 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f151a0c46c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15141239d0 con 0x7f1514122c90 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f15137fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 0x7f151411d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f15137fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 0x7f151411d390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:60900/0 (socket says 10.20.193.70:60900) 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f15137fe6c0 1 -- 10.20.193.70:0/2580133889 learned_addr learned my addr 10.20.193.70:0/2580133889 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f1513fff6c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1514122c90 0x7f1514123130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f1512ffd6c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1514115410 0x7f151411d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f15137fe6c0 1 -- 10.20.193.70:0/2580133889 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1514122c90 msgr2=0x7f1514123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:02.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f15137fe6c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1514122c90 0x7f1514123130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f15137fe6c0 1 -- 10.20.193.70:0/2580133889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1514115410 msgr2=0x7f151411d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f15137fe6c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1514115410 0x7f151411d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f15137fe6c0 1 -- 10.20.193.70:0/2580133889 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1500009590 con 0x7f151410f200 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f1512ffd6c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1514115410 0x7f151411d8d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.481+0000 7f15137fe6c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 0x7f151411d390 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f150002f230 tx=0x7f150002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.482+0000 7f1510ff96c0 1 -- 10.20.193.70:0/2580133889 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1500002ba0 con 0x7f151410f200 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.482+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1514163e20 con 0x7f151410f200 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.482+0000 7f1510ff96c0 1 -- 10.20.193.70:0/2580133889 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1500002d00 con 0x7f151410f200 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.482+0000 7f1510ff96c0 1 -- 10.20.193.70:0/2580133889 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15000372f0 con 0x7f151410f200 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.482+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1514164250 con 0x7f151410f200 2026-02-13T03:47:02.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.482+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15141104d0 con 0x7f151410f200 2026-02-13T03:47:02.487 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.483+0000 7f1510ff96c0 1 -- 10.20.193.70:0/2580133889 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f15000078d0 con 0x7f151410f200 2026-02-13T03:47:02.488 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.484+0000 7f1510ff96c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f14e80b5600 0x7f14e80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:02.488 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.484+0000 7f1512ffd6c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f14e80b5600 0x7f14e80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:02.488 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.484+0000 7f1510ff96c0 1 -- 10.20.193.70:0/2580133889 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f1500107be0 con 0x7f151410f200 2026-02-13T03:47:02.488 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.484+0000 7f1512ffd6c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f14e80b5600 0x7f14e80d5ab0 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1514123d20 tx=0x7f1504005df0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:02.488 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.484+0000 7f1510ff96c0 1 -- 10.20.193.70:0/2580133889 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f15000ca6a0 con 0x7f151410f200 2026-02-13T03:47:02.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.602+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f151410f5d0 con 0x7f151410f200 2026-02-13T03:47:02.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.602+0000 7f1510ff96c0 1 -- 10.20.193.70:0/2580133889 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f15000cd850 con 0x7f151410f200 2026-02-13T03:47:02.604 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:02.604 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:02.605 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f14e80b5600 msgr2=0x7f14e80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:02.605 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f14e80b5600 0x7f14e80d5ab0 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1514123d20 tx=0x7f1504005df0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.605 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 msgr2=0x7f151411d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:02.605 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 0x7f151411d390 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f150002f230 tx=0x7f150002fd40 comp rx=0 tx=0).stop 2026-02-13T03:47:02.605 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 shutdown_connections 2026-02-13T03:47:02.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f14e80b5600 0x7f14e80d5ab0 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1514122c90 0x7f1514123130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1514115410 0x7f151411d8d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 --2- 10.20.193.70:0/2580133889 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f151410f200 0x7f151411d390 unknown :-1 s=CLOSED pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:02.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 >> 10.20.193.70:0/2580133889 conn(0x7f15140ecb00 msgr2=0x7f151410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:02.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 shutdown_connections 2026-02-13T03:47:02.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:02.603+0000 7f151a0c46c0 1 -- 10.20.193.70:0/2580133889 wait complete. 2026-02-13T03:47:03.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:03 trial177 ceph-mon[27082]: pgmap v238: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:03.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:03 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2580133889' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:03.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:03 trial127 ceph-mon[26439]: pgmap v238: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:03.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:03 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2580133889' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:03.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:03 trial070 ceph-mon[24757]: pgmap v238: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:03.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:03 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2580133889' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:05.350 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:05 trial070 ceph-mon[24757]: pgmap v239: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:05.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:05 trial177 ceph-mon[27082]: pgmap v239: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:05 trial127 ceph-mon[26439]: pgmap v239: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:05.647 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:05.764 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:05.884 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/46848775 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 msgr2=0x7fed6010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:05.884 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/46848775 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 0x7fed6010f600 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=15110722057670293214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed540099a0 tx=0x7fed5402ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:05.884 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/46848775 shutdown_connections 2026-02-13T03:47:05.884 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/46848775 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed60115440 0x7fed60175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:05.884 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/46848775 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fed6010fc20 0x7fed60114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:05.884 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/46848775 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 0x7fed6010f600 unknown :-1 s=CLOSED pgs=369 gs=1 cs=0 l=1 c_cookie=15110722057670293214 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/46848775 >> 10.20.193.70:0/46848775 conn(0x7fed600ecb30 msgr2=0x7fed6010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/46848775 shutdown_connections 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/46848775 wait complete. 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 Processor -- start 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 -- start start 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 0x7fed6011d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fed60115440 0x7fed6011d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed60122c80 0x7fed60123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fed60123690 con 0x7fed6010f230 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fed60123800 con 0x7fed60122c80 2026-02-13T03:47:05.885 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed64b3b6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fed601239c0 con 0x7fed60115440 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.881+0000 7fed5e5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 0x7fed6011d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed5e5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 0x7fed6011d380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:60924/0 (socket says 10.20.193.70:60924) 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed5e5756c0 1 -- 10.20.193.70:0/2040734400 learned_addr learned my addr 10.20.193.70:0/2040734400 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed5ed766c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed60122c80 0x7fed60123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed5e5756c0 1 -- 10.20.193.70:0/2040734400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fed60115440 msgr2=0x7fed6011d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed5e5756c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fed60115440 0x7fed6011d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed5e5756c0 1 -- 10.20.193.70:0/2040734400 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed60122c80 msgr2=0x7fed60123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed5e5756c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed60122c80 0x7fed60123120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed5e5756c0 1 -- 10.20.193.70:0/2040734400 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed54009590 con 0x7fed6010f230 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed5e5756c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 0x7fed6011d380 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed5402f230 tx=0x7fed5402fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:05.886 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed477fe6c0 1 -- 10.20.193.70:0/2040734400 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed54002ba0 con 0x7fed6010f230 2026-02-13T03:47:05.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed477fe6c0 1 -- 10.20.193.70:0/2040734400 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fed54002d00 con 0x7fed6010f230 2026-02-13T03:47:05.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed60163e10 con 0x7fed6010f230 2026-02-13T03:47:05.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed477fe6c0 1 -- 10.20.193.70:0/2040734400 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed540372f0 con 0x7fed6010f230 2026-02-13T03:47:05.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed60164240 con 0x7fed6010f230 2026-02-13T03:47:05.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.882+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed60110500 con 0x7fed6010f230 2026-02-13T03:47:05.888 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.883+0000 7fed477fe6c0 1 -- 10.20.193.70:0/2040734400 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fed540078d0 con 0x7fed6010f230 2026-02-13T03:47:05.888 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.884+0000 7fed477fe6c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fed380b5600 0x7fed380d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:05.888 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.884+0000 7fed5dd746c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fed380b5600 0x7fed380d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:05.888 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.884+0000 7fed477fe6c0 1 -- 10.20.193.70:0/2040734400 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fed54107c30 con 0x7fed6010f230 2026-02-13T03:47:05.888 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.884+0000 7fed5dd746c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fed380b5600 0x7fed380d5ab0 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed48005980 tx=0x7fed48005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:05.888 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:05.884+0000 7fed477fe6c0 1 -- 10.20.193.70:0/2040734400 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fed540ca6b0 con 0x7fed6010f230 2026-02-13T03:47:06.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.006+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fed6010fc20 con 0x7fed6010f230 2026-02-13T03:47:06.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.007+0000 7fed477fe6c0 1 -- 10.20.193.70:0/2040734400 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fed540cd860 con 0x7fed6010f230 2026-02-13T03:47:06.008 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:06.009 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fed380b5600 msgr2=0x7fed380d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fed380b5600 0x7fed380d5ab0 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed48005980 tx=0x7fed48005910 comp rx=0 tx=0).stop 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 msgr2=0x7fed6011d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 0x7fed6011d380 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed5402f230 tx=0x7fed5402fd40 comp rx=0 tx=0).stop 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 shutdown_connections 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fed380b5600 0x7fed380d5ab0 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fed60122c80 0x7fed60123120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fed60115440 0x7fed6011d8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 --2- 10.20.193.70:0/2040734400 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fed6010f230 0x7fed6011d380 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:06.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 >> 10.20.193.70:0/2040734400 conn(0x7fed600ecb30 msgr2=0x7fed6010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:06.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 shutdown_connections 2026-02-13T03:47:06.011 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:06.008+0000 7fed64b3b6c0 1 -- 10.20.193.70:0/2040734400 wait complete. 2026-02-13T03:47:06.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:06 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2040734400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:06.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:06 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2040734400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:06.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:06 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2040734400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:07.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:07 trial177 ceph-mon[27082]: pgmap v240: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:07.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:07 trial127 ceph-mon[26439]: pgmap v240: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:07.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:07 trial070 ceph-mon[24757]: pgmap v240: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:09.051 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:09.171 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:09.286 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 -- 10.20.193.70:0/2717213078 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730115440 msgr2=0x7f3730175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:09.286 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 --2- 10.20.193.70:0/2717213078 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730115440 0x7f3730175de0 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=11310629486562418904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f372000aa70 tx=0x7f372002fdd0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.286 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 -- 10.20.193.70:0/2717213078 shutdown_connections 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 --2- 10.20.193.70:0/2717213078 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730115440 0x7f3730175de0 unknown :-1 s=CLOSED pgs=371 gs=1 cs=0 l=1 c_cookie=11310629486562418904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 --2- 10.20.193.70:0/2717213078 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f373010fc20 0x7f3730114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 --2- 10.20.193.70:0/2717213078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f373010f230 0x7f373010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 -- 10.20.193.70:0/2717213078 >> 10.20.193.70:0/2717213078 conn(0x7f37300ecb30 msgr2=0x7f373010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 -- 10.20.193.70:0/2717213078 shutdown_connections 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 -- 10.20.193.70:0/2717213078 wait complete. 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 Processor -- start 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.283+0000 7f37358e46c0 1 -- start start 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37358e46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f373010f230 0x7f373011d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:09.287 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37358e46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3730115440 0x7f373011d670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37358e46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730122a30 0x7f3730122ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37358e46c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3730123410 con 0x7f3730122a30 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37358e46c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3730123580 con 0x7f373010f230 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37358e46c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3730123740 con 0x7f3730115440 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372f7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730122a30 0x7f3730122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372f7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730122a30 0x7f3730122ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:39674/0 (socket says 10.20.193.70:39674) 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372f7fe6c0 1 -- 10.20.193.70:0/1543385190 learned_addr learned my addr 10.20.193.70:0/1543385190 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372e7fc6c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3730115440 0x7f373011d670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372effd6c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f373010f230 0x7f373011d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372f7fe6c0 1 -- 10.20.193.70:0/1543385190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3730115440 msgr2=0x7f373011d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372f7fe6c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3730115440 0x7f373011d670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.288 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372f7fe6c0 1 -- 10.20.193.70:0/1543385190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f373010f230 msgr2=0x7f373011d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372f7fe6c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f373010f230 0x7f373011d130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372f7fe6c0 1 -- 10.20.193.70:0/1543385190 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372000a660 con 0x7f3730122a30 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372effd6c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f373010f230 0x7f373011d130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f372f7fe6c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730122a30 0x7f3730122ed0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37200027a0 tx=0x7f37200055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37348e26c0 1 -- 10.20.193.70:0/1543385190 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3720003c40 con 0x7f3730122a30 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37348e26c0 1 -- 10.20.193.70:0/1543385190 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3720003da0 con 0x7f3730122a30 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3730163bc0 con 0x7f3730122a30 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37348e26c0 1 -- 10.20.193.70:0/1543385190 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3720037360 con 0x7f3730122a30 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.284+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3730164040 con 0x7f3730122a30 2026-02-13T03:47:09.289 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.285+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3730110500 con 0x7f3730122a30 2026-02-13T03:47:09.290 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.286+0000 7f37348e26c0 1 -- 10.20.193.70:0/1543385190 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f3720008a00 con 0x7f3730122a30 2026-02-13T03:47:09.290 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.286+0000 7f37348e26c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37040b5680 0x7f37040d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:09.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.286+0000 7f372effd6c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37040b5680 0x7f37040d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:09.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.287+0000 7f37348e26c0 1 -- 10.20.193.70:0/1543385190 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f3720108e30 con 0x7f3730122a30 2026-02-13T03:47:09.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.287+0000 7f372effd6c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37040b5680 0x7f37040d5b30 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3724004750 tx=0x7f3724005e50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:09.291 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.287+0000 7f37348e26c0 1 -- 10.20.193.70:0/1543385190 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f37200cb8b0 con 0x7f3730122a30 2026-02-13T03:47:09.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.405+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f373010f600 con 0x7f3730122a30 2026-02-13T03:47:09.407 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:09 trial070 ceph-mon[24757]: pgmap v241: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:09.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.405+0000 7f37348e26c0 1 -- 10.20.193.70:0/1543385190 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f37200cea60 con 0x7f3730122a30 2026-02-13T03:47:09.408 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:09.408 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:09.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37040b5680 msgr2=0x7f37040d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:09.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37040b5680 0x7f37040d5b30 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3724004750 tx=0x7f3724005e50 comp rx=0 tx=0).stop 2026-02-13T03:47:09.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730122a30 msgr2=0x7f3730122ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:09.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730122a30 0x7f3730122ed0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37200027a0 tx=0x7f37200055f0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 shutdown_connections 2026-02-13T03:47:09.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f37040b5680 0x7f37040d5b30 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3730122a30 0x7f3730122ed0 unknown :-1 s=CLOSED pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3730115440 0x7f373011d670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 --2- 10.20.193.70:0/1543385190 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f373010f230 0x7f373011d130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:09.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.406+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 >> 10.20.193.70:0/1543385190 conn(0x7f37300ecb30 msgr2=0x7f373010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:09.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.407+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 shutdown_connections 2026-02-13T03:47:09.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:09.407+0000 7f37358e46c0 1 -- 10.20.193.70:0/1543385190 wait complete. 2026-02-13T03:47:09.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:09 trial177 ceph-mon[27082]: pgmap v241: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:09.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:09 trial127 ceph-mon[26439]: pgmap v241: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:10.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:10 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1543385190' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:10.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:10 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1543385190' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:10.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:10 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1543385190' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:11.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:11 trial177 ceph-mon[27082]: pgmap v242: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:11.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:11 trial127 ceph-mon[26439]: pgmap v242: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:11.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:11 trial070 ceph-mon[24757]: pgmap v242: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:12.449 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:12.570 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:12.688 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 -- 10.20.193.70:0/3121970046 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c10f230 msgr2=0x7ff98c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/3121970046 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c10f230 0x7ff98c10f600 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=9590789287403995200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9780099a0 tx=0x7ff97802ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 -- 10.20.193.70:0/3121970046 shutdown_connections 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/3121970046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff98c115440 0x7ff98c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/3121970046 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff98c10fc20 0x7ff98c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/3121970046 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c10f230 0x7ff98c10f600 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=9590789287403995200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 -- 10.20.193.70:0/3121970046 >> 10.20.193.70:0/3121970046 conn(0x7ff98c0ecb30 msgr2=0x7ff98c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 -- 10.20.193.70:0/3121970046 shutdown_connections 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 -- 10.20.193.70:0/3121970046 wait complete. 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 Processor -- start 2026-02-13T03:47:12.689 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 -- start start 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff98c10f230 0x7ff98c11d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c115440 0x7ff98c11d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff98c122c80 0x7ff98c123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c123690 con 0x7ff98c115440 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c123800 con 0x7ff98c10f230 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.685+0000 7ff9925c96c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c1239c0 con 0x7ff98c122c80 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98b7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c115440 0x7ff98c11d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98b7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c115440 0x7ff98c11d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:39698/0 (socket says 10.20.193.70:39698) 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98b7fe6c0 1 -- 10.20.193.70:0/2629071336 learned_addr learned my addr 10.20.193.70:0/2629071336 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98bfff6c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff98c10f230 0x7ff98c11d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:12.690 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff990b3b6c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff98c122c80 0x7ff98c123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98b7fe6c0 1 -- 10.20.193.70:0/2629071336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff98c122c80 msgr2=0x7ff98c123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98b7fe6c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff98c122c80 0x7ff98c123120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98b7fe6c0 1 -- 10.20.193.70:0/2629071336 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff98c10f230 msgr2=0x7ff98c11d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98b7fe6c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff98c10f230 0x7ff98c11d380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98b7fe6c0 1 -- 10.20.193.70:0/2629071336 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff978009590 con 0x7ff98c115440 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff98b7fe6c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c115440 0x7ff98c11d8c0 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff97c005dc0 tx=0x7ff97c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff9897fa6c0 1 -- 10.20.193.70:0/2629071336 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff97c004250 con 0x7ff98c115440 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff9897fa6c0 1 -- 10.20.193.70:0/2629071336 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff97c009070 con 0x7ff98c115440 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98c163e70 con 0x7ff98c115440 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff9897fa6c0 1 -- 10.20.193.70:0/2629071336 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff97c00cd50 con 0x7ff98c115440 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98c164300 con 0x7ff98c115440 2026-02-13T03:47:12.691 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.686+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98c110500 con 0x7ff98c115440 2026-02-13T03:47:12.692 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.688+0000 7ff9897fa6c0 1 -- 10.20.193.70:0/2629071336 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff97c0028c0 con 0x7ff98c115440 2026-02-13T03:47:12.693 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.688+0000 7ff9897fa6c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff9600b5600 0x7ff9600d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:12.693 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.689+0000 7ff98bfff6c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff9600b5600 0x7ff9600d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:12.693 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.689+0000 7ff9897fa6c0 1 -- 10.20.193.70:0/2629071336 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7ff97c0e39c0 con 0x7ff98c115440 2026-02-13T03:47:12.693 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.689+0000 7ff9897fa6c0 1 -- 10.20.193.70:0/2629071336 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff97c0a6440 con 0x7ff98c115440 2026-02-13T03:47:12.693 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.689+0000 7ff98bfff6c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff9600b5600 0x7ff9600d5ab0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff978005b40 tx=0x7ff9780023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:12.808 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.807+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff98c10f600 con 0x7ff98c115440 2026-02-13T03:47:12.808 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.807+0000 7ff9897fa6c0 1 -- 10.20.193.70:0/2629071336 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff97c0a95f0 con 0x7ff98c115440 2026-02-13T03:47:12.808 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:12.808 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:12.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff9600b5600 msgr2=0x7ff9600d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:12.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff9600b5600 0x7ff9600d5ab0 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff978005b40 tx=0x7ff9780023a0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c115440 msgr2=0x7ff98c11d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:12.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c115440 0x7ff98c11d8c0 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff97c005dc0 tx=0x7ff97c00bbb0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 shutdown_connections 2026-02-13T03:47:12.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff9600b5600 0x7ff9600d5ab0 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff98c122c80 0x7ff98c123120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff98c115440 0x7ff98c11d8c0 unknown :-1 s=CLOSED pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 --2- 10.20.193.70:0/2629071336 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff98c10f230 0x7ff98c11d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:12.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 >> 10.20.193.70:0/2629071336 conn(0x7ff98c0ecb30 msgr2=0x7ff98c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:12.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 shutdown_connections 2026-02-13T03:47:12.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:12.808+0000 7ff9925c96c0 1 -- 10.20.193.70:0/2629071336 wait complete. 2026-02-13T03:47:13.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:13 trial177 ceph-mon[27082]: pgmap v243: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:13.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:13 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2629071336' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:13.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:13 trial127 ceph-mon[26439]: pgmap v243: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:13.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:13 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2629071336' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:13.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:13 trial070 ceph-mon[24757]: pgmap v243: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:13.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:13 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2629071336' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:15.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:15 trial177 ceph-mon[27082]: pgmap v244: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:15.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:15 trial127 ceph-mon[26439]: pgmap v244: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:15.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:15 trial070 ceph-mon[24757]: pgmap v244: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:15.850 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:15.969 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:16.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.085+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/2895148532 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc10f200 msgr2=0x7fa1bc10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:16.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.085+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/2895148532 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc10f200 0x7fa1bc10f5d0 secure :-1 s=READY pgs=375 gs=1 cs=0 l=1 c_cookie=13285301776863995671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1ac0099a0 tx=0x7fa1ac02ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:16.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.085+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/2895148532 shutdown_connections 2026-02-13T03:47:16.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.085+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/2895148532 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1bc115410 0x7fa1bc175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.085+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/2895148532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1bc10fbf0 0x7fa1bc114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.085+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/2895148532 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc10f200 0x7fa1bc10f5d0 unknown :-1 s=CLOSED pgs=375 gs=1 cs=0 l=1 c_cookie=13285301776863995671 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.085+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/2895148532 >> 10.20.193.70:0/2895148532 conn(0x7fa1bc0ecb00 msgr2=0x7fa1bc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.085+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/2895148532 shutdown_connections 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.085+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/2895148532 wait complete. 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c2fe96c0 1 Processor -- start 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c2fe96c0 1 -- start start 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c2fe96c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1bc10f200 0x7fa1bc11d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c2fe96c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1bc115410 0x7fa1bc11d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c2fe96c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc122c90 0x7fa1bc123130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c2fe96c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc1236a0 con 0x7fa1bc122c90 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c2fe96c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc123810 con 0x7fa1bc10f200 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c2fe96c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc1239d0 con 0x7fa1bc115410 2026-02-13T03:47:16.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c155b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc122c90 0x7fa1bc123130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c155b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc122c90 0x7fa1bc123130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53622/0 (socket says 10.20.193.70:53622) 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c155b6c0 1 -- 10.20.193.70:0/4076633388 learned_addr learned my addr 10.20.193.70:0/4076633388 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1b3fff6c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1bc115410 0x7fa1bc11d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c0d5a6c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1bc10f200 0x7fa1bc11d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c155b6c0 1 -- 10.20.193.70:0/4076633388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1bc115410 msgr2=0x7fa1bc11d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c155b6c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1bc115410 0x7fa1bc11d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c155b6c0 1 -- 10.20.193.70:0/4076633388 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1bc10f200 msgr2=0x7fa1bc11d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c155b6c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1bc10f200 0x7fa1bc11d390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c155b6c0 1 -- 10.20.193.70:0/4076633388 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac009590 con 0x7fa1bc122c90 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c155b6c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc122c90 0x7fa1bc123130 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b8006ea0 tx=0x7fa1b800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1b1ffb6c0 1 -- 10.20.193.70:0/4076633388 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1b8003a30 con 0x7fa1bc122c90 2026-02-13T03:47:16.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1b1ffb6c0 1 -- 10.20.193.70:0/4076633388 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa1b80054f0 con 0x7fa1bc122c90 2026-02-13T03:47:16.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1b1ffb6c0 1 -- 10.20.193.70:0/4076633388 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1b800dcd0 con 0x7fa1bc122c90 2026-02-13T03:47:16.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.086+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1bc163e80 con 0x7fa1bc122c90 2026-02-13T03:47:16.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.087+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1bc164310 con 0x7fa1bc122c90 2026-02-13T03:47:16.092 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.087+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1bc1104d0 con 0x7fa1bc122c90 2026-02-13T03:47:16.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.088+0000 7fa1b1ffb6c0 1 -- 10.20.193.70:0/4076633388 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fa1b8005030 con 0x7fa1bc122c90 2026-02-13T03:47:16.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.089+0000 7fa1b1ffb6c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1980b5680 0x7fa1980d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:16.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.089+0000 7fa1c0d5a6c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1980b5680 0x7fa1980d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:16.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.089+0000 7fa1b1ffb6c0 1 -- 10.20.193.70:0/4076633388 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fa1b80e4b20 con 0x7fa1bc122c90 2026-02-13T03:47:16.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.089+0000 7fa1b1ffb6c0 1 -- 10.20.193.70:0/4076633388 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa1b80ab000 con 0x7fa1bc122c90 2026-02-13T03:47:16.093 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.089+0000 7fa1c0d5a6c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1980b5680 0x7fa1980d5b30 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1ac0092e0 tx=0x7fa1ac005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:16.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.207+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa1bc11e540 con 0x7fa1bc122c90 2026-02-13T03:47:16.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.207+0000 7fa1b1ffb6c0 1 -- 10.20.193.70:0/4076633388 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa1b800de60 con 0x7fa1bc122c90 2026-02-13T03:47:16.208 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:16.209 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:16.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1980b5680 msgr2=0x7fa1980d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:16.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1980b5680 0x7fa1980d5b30 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1ac0092e0 tx=0x7fa1ac005c00 comp rx=0 tx=0).stop 2026-02-13T03:47:16.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc122c90 msgr2=0x7fa1bc123130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:16.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc122c90 0x7fa1bc123130 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1b8006ea0 tx=0x7fa1b800cca0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 shutdown_connections 2026-02-13T03:47:16.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1980b5680 0x7fa1980d5b30 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1bc122c90 0x7fa1bc123130 unknown :-1 s=CLOSED pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1bc115410 0x7fa1bc11d8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 --2- 10.20.193.70:0/4076633388 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1bc10f200 0x7fa1bc11d390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:16.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 >> 10.20.193.70:0/4076633388 conn(0x7fa1bc0ecb00 msgr2=0x7fa1bc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:16.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 shutdown_connections 2026-02-13T03:47:16.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:16.208+0000 7fa1c2fe96c0 1 -- 10.20.193.70:0/4076633388 wait complete. 2026-02-13T03:47:17.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:17 trial177 ceph-mon[27082]: pgmap v245: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:17.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:17 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4076633388' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:17.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:17 trial127 ceph-mon[26439]: pgmap v245: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:17.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:17 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4076633388' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:17.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:17 trial070 ceph-mon[24757]: pgmap v245: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:17.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:17 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4076633388' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:19.269 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:19.387 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:19.410 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:19 trial070 ceph-mon[24757]: pgmap v246: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:19.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:19 trial177 ceph-mon[27082]: pgmap v246: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:19.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:19 trial127 ceph-mon[26439]: pgmap v246: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:19.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.506+0000 7f83770c86c0 1 -- 10.20.193.70:0/3066213067 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f837010fc20 msgr2=0x7f8370114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:19.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.506+0000 7f83770c86c0 1 --2- 10.20.193.70:0/3066213067 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f837010fc20 0x7f8370114c60 secure :-1 s=READY pgs=377 gs=1 cs=0 l=1 c_cookie=13988392993571678397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83580099a0 tx=0x7f835802ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:19.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.506+0000 7f83770c86c0 1 -- 10.20.193.70:0/3066213067 shutdown_connections 2026-02-13T03:47:19.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.506+0000 7f83770c86c0 1 --2- 10.20.193.70:0/3066213067 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8370115440 0x7f8370175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.506+0000 7f83770c86c0 1 --2- 10.20.193.70:0/3066213067 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f837010fc20 0x7f8370114c60 unknown :-1 s=CLOSED pgs=377 gs=1 cs=0 l=1 c_cookie=13988392993571678397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.506+0000 7f83770c86c0 1 --2- 10.20.193.70:0/3066213067 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f837010f230 0x7f837010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.506+0000 7f83770c86c0 1 -- 10.20.193.70:0/3066213067 >> 10.20.193.70:0/3066213067 conn(0x7f83700ecb30 msgr2=0x7f837010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.506+0000 7f83770c86c0 1 -- 10.20.193.70:0/3066213067 shutdown_connections 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 -- 10.20.193.70:0/3066213067 wait complete. 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 Processor -- start 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 -- start start 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f837010f230 0x7f83700f4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8370115440 0x7f8370175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:19.511 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f83700f5330 0x7f83700fa5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83700f5a20 con 0x7f83700f5330 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f83700faaf0 con 0x7f837010f230 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83700facb0 con 0x7f8370115440 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f837563a6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f83700f5330 0x7f83700fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f837563a6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f83700f5330 0x7f83700fa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53640/0 (socket says 10.20.193.70:53640) 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f837563a6c0 1 -- 10.20.193.70:0/4075806637 learned_addr learned my addr 10.20.193.70:0/4075806637 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f8374e396c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f837010f230 0x7f83700f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f8367fff6c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8370115440 0x7f8370175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f837563a6c0 1 -- 10.20.193.70:0/4075806637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8370115440 msgr2=0x7f8370175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f837563a6c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8370115440 0x7f8370175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f837563a6c0 1 -- 10.20.193.70:0/4075806637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f837010f230 msgr2=0x7f83700f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:19.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f837563a6c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f837010f230 0x7f83700f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f837563a6c0 1 -- 10.20.193.70:0/4075806637 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8358009590 con 0x7f83700f5330 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f8374e396c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f837010f230 0x7f83700f4d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f837563a6c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f83700f5330 0x7f83700fa5b0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f836c006ea0 tx=0x7f836c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f8365ffb6c0 1 -- 10.20.193.70:0/4075806637 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f836c003a30 con 0x7f83700f5330 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f8365ffb6c0 1 -- 10.20.193.70:0/4075806637 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f836c0054f0 con 0x7f83700f5330 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f8365ffb6c0 1 -- 10.20.193.70:0/4075806637 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f836c00dcd0 con 0x7f83700f5330 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.507+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83700faf90 con 0x7f83700f5330 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.508+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83700fb420 con 0x7f83700f5330 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.508+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8370110500 con 0x7f83700f5330 2026-02-13T03:47:19.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.509+0000 7f8365ffb6c0 1 -- 10.20.193.70:0/4075806637 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f836c003b90 con 0x7f83700f5330 2026-02-13T03:47:19.514 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.510+0000 7f8365ffb6c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f834c0b5600 0x7f834c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:19.514 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.510+0000 7f8374e396c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f834c0b5600 0x7f834c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:19.514 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.510+0000 7f8365ffb6c0 1 -- 10.20.193.70:0/4075806637 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f836c0e4940 con 0x7f83700f5330 2026-02-13T03:47:19.515 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.510+0000 7f8365ffb6c0 1 -- 10.20.193.70:0/4075806637 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f836c0e4e30 con 0x7f83700f5330 2026-02-13T03:47:19.515 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.510+0000 7f8374e396c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f834c0b5600 0x7f834c0d5ab0 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8360004750 tx=0x7f8360009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:19.629 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.628+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f837010f600 con 0x7f83700f5330 2026-02-13T03:47:19.630 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.628+0000 7f8365ffb6c0 1 -- 10.20.193.70:0/4075806637 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f836c0a7400 con 0x7f83700f5330 2026-02-13T03:47:19.630 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:19.630 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:19.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.629+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f834c0b5600 msgr2=0x7f834c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:19.631 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.629+0000 7f83770c86c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f834c0b5600 0x7f834c0d5ab0 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8360004750 tx=0x7f8360009260 comp rx=0 tx=0).stop 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.629+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f83700f5330 msgr2=0x7f83700fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.629+0000 7f83770c86c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f83700f5330 0x7f83700fa5b0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f836c006ea0 tx=0x7f836c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.629+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 shutdown_connections 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.629+0000 7f83770c86c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f834c0b5600 0x7f834c0d5ab0 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.629+0000 7f83770c86c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f83700f5330 0x7f83700fa5b0 unknown :-1 s=CLOSED pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.629+0000 7f83770c86c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8370115440 0x7f8370175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.629+0000 7f83770c86c0 1 --2- 10.20.193.70:0/4075806637 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f837010f230 0x7f83700f4d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.630+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 >> 10.20.193.70:0/4075806637 conn(0x7f83700ecb30 msgr2=0x7f837010d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.630+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 shutdown_connections 2026-02-13T03:47:19.632 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:19.630+0000 7f83770c86c0 1 -- 10.20.193.70:0/4075806637 wait complete. 2026-02-13T03:47:20.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:20 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4075806637' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:20.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:20 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4075806637' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:20.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:20 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4075806637' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:21.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:21 trial177 ceph-mon[27082]: pgmap v247: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:21.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:21 trial127 ceph-mon[26439]: pgmap v247: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:21.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:21 trial070 ceph-mon[24757]: pgmap v247: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:22.675 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:22.798 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:22.912 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/929611944 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 msgr2=0x7ff1a4152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:22.912 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/929611944 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 0x7ff1a4152d30 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=11265137792600995499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff194009970 tx=0x7ff19402ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:22.912 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/929611944 shutdown_connections 2026-02-13T03:47:22.912 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/929611944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1a4153300 0x7ff1a4173740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:22.912 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/929611944 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 0x7ff1a4152d30 unknown :-1 s=CLOSED pgs=379 gs=1 cs=0 l=1 c_cookie=11265137792600995499 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:22.912 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/929611944 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1a410dd50 0x7ff1a410e120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:22.912 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/929611944 >> 10.20.193.70:0/929611944 conn(0x7ff1a40e9770 msgr2=0x7ff1a4109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/929611944 shutdown_connections 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/929611944 wait complete. 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 Processor -- start 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 -- start start 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1a410dd50 0x7ff1a410bb50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 0x7ff1a410c090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1a4153300 0x7ff1a410c5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a414ed80 con 0x7ff1a410e740 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a414eef0 con 0x7ff1a410dd50 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1aa89c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a414f0b0 con 0x7ff1a4153300 2026-02-13T03:47:22.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1a37fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 0x7ff1a410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1a37fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 0x7ff1a410c090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53660/0 (socket says 10.20.193.70:53660) 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.909+0000 7ff1a37fe6c0 1 -- 10.20.193.70:0/2042816471 learned_addr learned my addr 10.20.193.70:0/2042816471 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a3fff6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1a410dd50 0x7ff1a410bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a37fe6c0 1 -- 10.20.193.70:0/2042816471 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1a4153300 msgr2=0x7ff1a410c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a8e0e6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1a4153300 0x7ff1a410c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a37fe6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1a4153300 0x7ff1a410c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a37fe6c0 1 -- 10.20.193.70:0/2042816471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1a410dd50 msgr2=0x7ff1a410bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a37fe6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1a410dd50 0x7ff1a410bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a37fe6c0 1 -- 10.20.193.70:0/2042816471 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff194009590 con 0x7ff1a410e740 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a37fe6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 0x7ff1a410c090 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1940092b0 tx=0x7ff19402fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a17fa6c0 1 -- 10.20.193.70:0/2042816471 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff194002ba0 con 0x7ff1a410e740 2026-02-13T03:47:22.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a414f330 con 0x7ff1a410e740 2026-02-13T03:47:22.915 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a17fa6c0 1 -- 10.20.193.70:0/2042816471 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff194007680 con 0x7ff1a410e740 2026-02-13T03:47:22.915 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1a17fa6c0 1 -- 10.20.193.70:0/2042816471 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff194037520 con 0x7ff1a410e740 2026-02-13T03:47:22.915 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a414f7b0 con 0x7ff1a410e740 2026-02-13T03:47:22.915 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.910+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a405fb90 con 0x7ff1a410e740 2026-02-13T03:47:22.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.912+0000 7ff1a17fa6c0 1 -- 10.20.193.70:0/2042816471 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff194002d00 con 0x7ff1a410e740 2026-02-13T03:47:22.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.912+0000 7ff1a17fa6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1780b5600 0x7ff1780d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:22.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.912+0000 7ff1a17fa6c0 1 -- 10.20.193.70:0/2042816471 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7ff194107be0 con 0x7ff1a410e740 2026-02-13T03:47:22.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.912+0000 7ff1a3fff6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1780b5600 0x7ff1780d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:22.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.912+0000 7ff1a3fff6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1780b5600 0x7ff1780d5ab0 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff190005980 tx=0x7ff190005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:22.916 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:22.912+0000 7ff1a17fa6c0 1 -- 10.20.193.70:0/2042816471 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff1940ca6f0 con 0x7ff1a410e740 2026-02-13T03:47:23.032 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.030+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff1a410ceb0 con 0x7ff1a410e740 2026-02-13T03:47:23.032 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.030+0000 7ff1a17fa6c0 1 -- 10.20.193.70:0/2042816471 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff194007cb0 con 0x7ff1a410e740 2026-02-13T03:47:23.032 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:23.032 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:23.033 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1780b5600 msgr2=0x7ff1780d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1780b5600 0x7ff1780d5ab0 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff190005980 tx=0x7ff190005910 comp rx=0 tx=0).stop 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 msgr2=0x7ff1a410c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 0x7ff1a410c090 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1940092b0 tx=0x7ff19402fd40 comp rx=0 tx=0).stop 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 shutdown_connections 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff1780b5600 0x7ff1780d5ab0 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff1a4153300 0x7ff1a410c5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff1a410e740 0x7ff1a410c090 unknown :-1 s=CLOSED pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 --2- 10.20.193.70:0/2042816471 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff1a410dd50 0x7ff1a410bb50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 >> 10.20.193.70:0/2042816471 conn(0x7ff1a40e9770 msgr2=0x7ff1a4109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:23.034 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 shutdown_connections 2026-02-13T03:47:23.035 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:23.032+0000 7ff1aa89c6c0 1 -- 10.20.193.70:0/2042816471 wait complete. 2026-02-13T03:47:23.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:23 trial070 ceph-mon[24757]: pgmap v248: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:23.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:23 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2042816471' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:23.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:23 trial177 ceph-mon[27082]: pgmap v248: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:23.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:23 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2042816471' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:23.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:23 trial127 ceph-mon[26439]: pgmap v248: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:23.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:23 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2042816471' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:24.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:24 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:47:24.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:24 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:47:24.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:24 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:47:25.338 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: pgmap v249: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:25.338 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.338 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.338 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.338 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.339 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.339 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.339 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:47:25.339 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:47:25.339 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.339 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:47:25.339 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:47:25.339 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:25 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:47:25.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: pgmap v249: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:25.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:47:25.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:47:25.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:47:25.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:47:25.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:25 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:47:25.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: pgmap v249: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:47:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:47:25.549 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:25 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:47:26.075 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:26.194 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:26.321 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.317+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1018125268 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc81131c0 msgr2=0x7fdfc8173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:26.321 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.317+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1018125268 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc81131c0 0x7fdfc8173b60 secure :-1 s=READY pgs=381 gs=1 cs=0 l=1 c_cookie=17294658959862562851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfc400aa70 tx=0x7fdfc402fde0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.321 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.317+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1018125268 shutdown_connections 2026-02-13T03:47:26.321 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.317+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1018125268 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc81131c0 0x7fdfc8173b60 unknown :-1 s=CLOSED pgs=381 gs=1 cs=0 l=1 c_cookie=17294658959862562851 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.321 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.317+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1018125268 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfc810d9a0 0x7fdfc81129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.321 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.317+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1018125268 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfc810cfb0 0x7fdfc810d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.321 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.317+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1018125268 >> 10.20.193.70:0/1018125268 conn(0x7fdfc80ea8b0 msgr2=0x7fdfc810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.317+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1018125268 shutdown_connections 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.317+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1018125268 wait complete. 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 Processor -- start 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 -- start start 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfc810cfb0 0x7fdfc80f4c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfc81131c0 0x7fdfc8173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc80f5250 0x7fdfc80fa520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc80f5940 con 0x7fdfc80f5250 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc80faa60 con 0x7fdfc81131c0 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc80fac20 con 0x7fdfc810cfb0 2026-02-13T03:47:26.322 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfce1c76c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc80f5250 0x7fdfc80fa520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfce1c76c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc80f5250 0x7fdfc80fa520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53064/0 (socket says 10.20.193.70:53064) 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfce1c76c0 1 -- 10.20.193.70:0/1661256212 learned_addr learned my addr 10.20.193.70:0/1661256212 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcd9c66c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfc810cfb0 0x7fdfc80f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcd1c56c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfc81131c0 0x7fdfc8173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfce1c76c0 1 -- 10.20.193.70:0/1661256212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfc810cfb0 msgr2=0x7fdfc80f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfce1c76c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfc810cfb0 0x7fdfc80f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfce1c76c0 1 -- 10.20.193.70:0/1661256212 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfc81131c0 msgr2=0x7fdfc8173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfce1c76c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfc81131c0 0x7fdfc8173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfce1c76c0 1 -- 10.20.193.70:0/1661256212 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc400a660 con 0x7fdfc80f5250 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfce1c76c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc80f5250 0x7fdfc80fa520 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfc4006ec0 tx=0x7fdfc4005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfb6ffd6c0 1 -- 10.20.193.70:0/1661256212 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfc4003c40 con 0x7fdfc80f5250 2026-02-13T03:47:26.323 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc80faea0 con 0x7fdfc80f5250 2026-02-13T03:47:26.324 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfb6ffd6c0 1 -- 10.20.193.70:0/1661256212 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdfc4005780 con 0x7fdfc80f5250 2026-02-13T03:47:26.324 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfb6ffd6c0 1 -- 10.20.193.70:0/1661256212 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfc40382f0 con 0x7fdfc80f5250 2026-02-13T03:47:26.324 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.318+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc80fb2d0 con 0x7fdfc80f5250 2026-02-13T03:47:26.324 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.319+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc810e280 con 0x7fdfc80f5250 2026-02-13T03:47:26.324 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.320+0000 7fdfb6ffd6c0 1 -- 10.20.193.70:0/1661256212 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fdfc4008260 con 0x7fdfc80f5250 2026-02-13T03:47:26.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.321+0000 7fdfb6ffd6c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdfa40b5600 0x7fdfa40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:26.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.321+0000 7fdfcd9c66c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdfa40b5600 0x7fdfa40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:26.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.321+0000 7fdfb6ffd6c0 1 -- 10.20.193.70:0/1661256212 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fdfc4108e20 con 0x7fdfc80f5250 2026-02-13T03:47:26.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.321+0000 7fdfb6ffd6c0 1 -- 10.20.193.70:0/1661256212 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdfc40cea50 con 0x7fdfc80f5250 2026-02-13T03:47:26.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.321+0000 7fdfcd9c66c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdfa40b5600 0x7fdfa40d5ab0 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb8005980 tx=0x7fdfb8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:26.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.437+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdfc810d380 con 0x7fdfc80f5250 2026-02-13T03:47:26.439 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:26 trial070 ceph-mon[24757]: pgmap v250: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 2 op/s 2026-02-13T03:47:26.439 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.437+0000 7fdfb6ffd6c0 1 -- 10.20.193.70:0/1661256212 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdfc40cec30 con 0x7fdfc80f5250 2026-02-13T03:47:26.439 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:26.440 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:26.440 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdfa40b5600 msgr2=0x7fdfa40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdfa40b5600 0x7fdfa40d5ab0 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfb8005980 tx=0x7fdfb8005910 comp rx=0 tx=0).stop 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc80f5250 msgr2=0x7fdfc80fa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc80f5250 0x7fdfc80fa520 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfc4006ec0 tx=0x7fdfc4005520 comp rx=0 tx=0).stop 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 shutdown_connections 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdfa40b5600 0x7fdfa40d5ab0 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdfc80f5250 0x7fdfc80fa520 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdfc81131c0 0x7fdfc8173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 --2- 10.20.193.70:0/1661256212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfc810cfb0 0x7fdfc80f4c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 >> 10.20.193.70:0/1661256212 conn(0x7fdfc80ea8b0 msgr2=0x7fdfc810e770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:26.441 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 shutdown_connections 2026-02-13T03:47:26.442 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:26.439+0000 7fdfcfc556c0 1 -- 10.20.193.70:0/1661256212 wait complete. 2026-02-13T03:47:26.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:26 trial177 ceph-mon[27082]: pgmap v250: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 2 op/s 2026-02-13T03:47:26.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:26 trial127 ceph-mon[26439]: pgmap v250: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s rd, 2 op/s 2026-02-13T03:47:27.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:27 trial177 ceph-mon[27082]: pgmap v251: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:27.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:27 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1661256212' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:27.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:27 trial127 ceph-mon[26439]: pgmap v251: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:27.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:27 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1661256212' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:27.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:27 trial070 ceph-mon[24757]: pgmap v251: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:27.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:27 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1661256212' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:29.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:29 trial177 ceph-mon[27082]: pgmap v252: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:29.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:29 trial127 ceph-mon[26439]: pgmap v252: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:29.483 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:29.508 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:29 trial070 ceph-mon[24757]: pgmap v252: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:29.602 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:29.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 -- 10.20.193.70:0/3546834906 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 msgr2=0x7f0888175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:29.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 --2- 10.20.193.70:0/3546834906 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 0x7f0888175de0 secure :-1 s=READY pgs=383 gs=1 cs=0 l=1 c_cookie=3813346557354498652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f087800aa70 tx=0x7f087802fde0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 -- 10.20.193.70:0/3546834906 shutdown_connections 2026-02-13T03:47:29.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 --2- 10.20.193.70:0/3546834906 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 0x7f0888175de0 unknown :-1 s=CLOSED pgs=383 gs=1 cs=0 l=1 c_cookie=3813346557354498652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 --2- 10.20.193.70:0/3546834906 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f088810fc20 0x7f0888114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 --2- 10.20.193.70:0/3546834906 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f088810f230 0x7f088810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 -- 10.20.193.70:0/3546834906 >> 10.20.193.70:0/3546834906 conn(0x7f08880ecb30 msgr2=0x7f088810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 -- 10.20.193.70:0/3546834906 shutdown_connections 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 -- 10.20.193.70:0/3546834906 wait complete. 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 Processor -- start 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 -- start start 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f088810f230 0x7f088811d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 0x7f088811d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0888122ae0 0x7f0888122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.726+0000 7f088cc106c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f08881234f0 con 0x7f0888115440 2026-02-13T03:47:29.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f088cc106c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0888123660 con 0x7f0888122ae0 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f088cc106c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0888123820 con 0x7f088810f230 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f0885d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 0x7f088811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f0885d746c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 0x7f088811d720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53082/0 (socket says 10.20.193.70:53082) 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f0885d746c0 1 -- 10.20.193.70:0/734967444 learned_addr learned my addr 10.20.193.70:0/734967444 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f08865756c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f088810f230 0x7f088811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f0885d746c0 1 -- 10.20.193.70:0/734967444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f088810f230 msgr2=0x7f088811d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f0885d746c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f088810f230 0x7f088811d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f0885d746c0 1 -- 10.20.193.70:0/734967444 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0888122ae0 msgr2=0x7f0888122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f0885d746c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0888122ae0 0x7f0888122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f0885d746c0 1 -- 10.20.193.70:0/734967444 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087800a660 con 0x7f0888115440 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f0885d746c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 0x7f088811d720 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f087000b6c0 tx=0x7f087000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:29.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f086f7fe6c0 1 -- 10.20.193.70:0/734967444 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0870004250 con 0x7f0888115440 2026-02-13T03:47:29.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f086f7fe6c0 1 -- 10.20.193.70:0/734967444 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0870009070 con 0x7f0888115440 2026-02-13T03:47:29.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f086f7fe6c0 1 -- 10.20.193.70:0/734967444 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f087000ccb0 con 0x7f0888115440 2026-02-13T03:47:29.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0888163cd0 con 0x7f0888115440 2026-02-13T03:47:29.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0888164160 con 0x7f0888115440 2026-02-13T03:47:29.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.727+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0888110500 con 0x7f0888115440 2026-02-13T03:47:29.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.729+0000 7f086f7fe6c0 1 -- 10.20.193.70:0/734967444 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f08700028c0 con 0x7f0888115440 2026-02-13T03:47:29.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.729+0000 7f086f7fe6c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f08600b5600 0x7f08600d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:29.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.729+0000 7f08865756c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f08600b5600 0x7f08600d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:29.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.729+0000 7f086f7fe6c0 1 -- 10.20.193.70:0/734967444 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f08700e3ae0 con 0x7f0888115440 2026-02-13T03:47:29.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.730+0000 7f08865756c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f08600b5600 0x7f08600d5ab0 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f087c005980 tx=0x7f087c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:29.733 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.730+0000 7f086f7fe6c0 1 -- 10.20.193.70:0/734967444 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f08700a65a0 con 0x7f0888115440 2026-02-13T03:47:29.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.849+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f088811e390 con 0x7f0888115440 2026-02-13T03:47:29.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.850+0000 7f086f7fe6c0 1 -- 10.20.193.70:0/734967444 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f08700a9750 con 0x7f0888115440 2026-02-13T03:47:29.851 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:29.851 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:29.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.850+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f08600b5600 msgr2=0x7f08600d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:29.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.850+0000 7f088cc106c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f08600b5600 0x7f08600d5ab0 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f087c005980 tx=0x7f087c005910 comp rx=0 tx=0).stop 2026-02-13T03:47:29.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.850+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 msgr2=0x7f088811d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:29.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.850+0000 7f088cc106c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 0x7f088811d720 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f087000b6c0 tx=0x7f087000bb90 comp rx=0 tx=0).stop 2026-02-13T03:47:29.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.851+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 shutdown_connections 2026-02-13T03:47:29.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.851+0000 7f088cc106c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f08600b5600 0x7f08600d5ab0 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.851+0000 7f088cc106c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0888122ae0 0x7f0888122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.851+0000 7f088cc106c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0888115440 0x7f088811d720 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.851+0000 7f088cc106c0 1 --2- 10.20.193.70:0/734967444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f088810f230 0x7f088811d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:29.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.851+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 >> 10.20.193.70:0/734967444 conn(0x7f08880ecb30 msgr2=0x7f088810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:29.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.851+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 shutdown_connections 2026-02-13T03:47:29.853 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:29.851+0000 7f088cc106c0 1 -- 10.20.193.70:0/734967444 wait complete. 2026-02-13T03:47:30.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:30 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/734967444' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:30.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:30 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/734967444' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:30.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:30 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/734967444' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:31.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:31 trial177 ceph-mon[27082]: pgmap v253: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:31.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:31 trial127 ceph-mon[26439]: pgmap v253: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:31.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:31 trial070 ceph-mon[24757]: pgmap v253: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:32.894 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:33.014 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:33.132 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2831972824 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e1810cfb0 msgr2=0x7f1e1810d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:33.132 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2831972824 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e1810cfb0 0x7f1e1810d380 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=10810586845046347238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e0c0099a0 tx=0x7f1e0c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:33.132 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2831972824 shutdown_connections 2026-02-13T03:47:33.132 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2831972824 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e181131c0 0x7f1e18173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2831972824 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e1810d9a0 0x7f1e181129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2831972824 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e1810cfb0 0x7f1e1810d380 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=10810586845046347238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2831972824 >> 10.20.193.70:0/2831972824 conn(0x7f1e180ea8b0 msgr2=0x7f1e1810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2831972824 shutdown_connections 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2831972824 wait complete. 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 Processor -- start 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 -- start start 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e1810cfb0 0x7f1e180f4d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e181131c0 0x7f1e18173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e180f5340 0x7f1e180fa610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:33.133 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1e180f5a30 con 0x7f1e180f5340 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1e180fab50 con 0x7f1e181131c0 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e1ccfc6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1e180fad10 con 0x7f1e1810cfb0 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e16d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e180f5340 0x7f1e180fa610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e16d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e180f5340 0x7f1e180fa610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53092/0 (socket says 10.20.193.70:53092) 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.129+0000 7f1e16d766c0 1 -- 10.20.193.70:0/2225679916 learned_addr learned my addr 10.20.193.70:0/2225679916 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e15d746c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e181131c0 0x7f1e18173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e165756c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e1810cfb0 0x7f1e180f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e16d766c0 1 -- 10.20.193.70:0/2225679916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e1810cfb0 msgr2=0x7f1e180f4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e16d766c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e1810cfb0 0x7f1e180f4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e16d766c0 1 -- 10.20.193.70:0/2225679916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e181131c0 msgr2=0x7f1e18173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e16d766c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e181131c0 0x7f1e18173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.134 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e16d766c0 1 -- 10.20.193.70:0/2225679916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c009590 con 0x7f1e180f5340 2026-02-13T03:47:33.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e16d766c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e180f5340 0x7f1e180fa610 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e08006ea0 tx=0x7f1e0800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:33.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1dff7fe6c0 1 -- 10.20.193.70:0/2225679916 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e08003a30 con 0x7f1e180f5340 2026-02-13T03:47:33.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1dff7fe6c0 1 -- 10.20.193.70:0/2225679916 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1e080054f0 con 0x7f1e180f5340 2026-02-13T03:47:33.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e180faff0 con 0x7f1e180f5340 2026-02-13T03:47:33.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1dff7fe6c0 1 -- 10.20.193.70:0/2225679916 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e0800dcd0 con 0x7f1e180f5340 2026-02-13T03:47:33.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e180fb480 con 0x7f1e180f5340 2026-02-13T03:47:33.135 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.130+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e1810e280 con 0x7f1e180f5340 2026-02-13T03:47:33.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.132+0000 7f1dff7fe6c0 1 -- 10.20.193.70:0/2225679916 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f1e08003b90 con 0x7f1e180f5340 2026-02-13T03:47:33.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.132+0000 7f1dff7fe6c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1df00b5600 0x7f1df00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:33.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.132+0000 7f1dff7fe6c0 1 -- 10.20.193.70:0/2225679916 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f1e080e4880 con 0x7f1e180f5340 2026-02-13T03:47:33.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.132+0000 7f1e165756c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1df00b5600 0x7f1df00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:33.136 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.133+0000 7f1e165756c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1df00b5600 0x7f1df00d5ab0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e0c0092e0 tx=0x7f1e0c005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:33.137 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.133+0000 7f1dff7fe6c0 1 -- 10.20.193.70:0/2225679916 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1e080a7300 con 0x7f1e180f5340 2026-02-13T03:47:33.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.251+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1e1810d380 con 0x7f1e180f5340 2026-02-13T03:47:33.252 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:33 trial070 ceph-mon[24757]: pgmap v254: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:33.252 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.251+0000 7f1dff7fe6c0 1 -- 10.20.193.70:0/2225679916 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1e0800de60 con 0x7f1e180f5340 2026-02-13T03:47:33.253 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:33.253 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:33.254 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1df00b5600 msgr2=0x7f1df00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:33.254 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1df00b5600 0x7f1df00d5ab0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e0c0092e0 tx=0x7f1e0c005c00 comp rx=0 tx=0).stop 2026-02-13T03:47:33.254 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e180f5340 msgr2=0x7f1e180fa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:33.254 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e180f5340 0x7f1e180fa610 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e08006ea0 tx=0x7f1e0800cca0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.254 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 shutdown_connections 2026-02-13T03:47:33.254 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f1df00b5600 0x7f1df00d5ab0 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.254 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f1e180f5340 0x7f1e180fa610 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.255 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f1e181131c0 0x7f1e18173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.255 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 --2- 10.20.193.70:0/2225679916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e1810cfb0 0x7f1e180f4d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:33.255 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 >> 10.20.193.70:0/2225679916 conn(0x7f1e180ea8b0 msgr2=0x7f1e1810fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:33.255 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 shutdown_connections 2026-02-13T03:47:33.255 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:33.252+0000 7f1e1ccfc6c0 1 -- 10.20.193.70:0/2225679916 wait complete. 2026-02-13T03:47:33.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:33 trial177 ceph-mon[27082]: pgmap v254: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:33.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:33 trial127 ceph-mon[26439]: pgmap v254: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:34.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:34 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2225679916' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:34.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:34 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2225679916' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:34.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:34 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2225679916' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:35.449 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:35 trial070 ceph-mon[24757]: pgmap v255: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:35.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:35 trial177 ceph-mon[27082]: pgmap v255: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:35 trial127 ceph-mon[26439]: pgmap v255: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s rd, 2 op/s 2026-02-13T03:47:36.294 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:36.414 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:36.540 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2742187995 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 msgr2=0x7eff58175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:36.540 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2742187995 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 0x7eff58175de0 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=5037964613559020011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff4800aa70 tx=0x7eff4802fde0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.540 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2742187995 shutdown_connections 2026-02-13T03:47:36.540 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2742187995 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 0x7eff58175de0 unknown :-1 s=CLOSED pgs=387 gs=1 cs=0 l=1 c_cookie=5037964613559020011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2742187995 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff5810fc20 0x7eff58114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2742187995 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff5810f230 0x7eff5810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2742187995 >> 10.20.193.70:0/2742187995 conn(0x7eff580ecb30 msgr2=0x7eff5810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2742187995 shutdown_connections 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2742187995 wait complete. 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 Processor -- start 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 -- start start 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff5810f230 0x7eff5811d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 0x7eff5811d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:36.541 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff58122ae0 0x7eff58122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff581234f0 con 0x7eff58115440 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7eff58123660 con 0x7eff58122ae0 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff5d58f6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7eff58123820 con 0x7eff5810f230 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff567fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 0x7eff5811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff567fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 0x7eff5811d720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:44632/0 (socket says 10.20.193.70:44632) 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.537+0000 7eff567fc6c0 1 -- 10.20.193.70:0/2083309364 learned_addr learned my addr 10.20.193.70:0/2083309364 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff56ffd6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff5810f230 0x7eff5811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff577fe6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff58122ae0 0x7eff58122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff567fc6c0 1 -- 10.20.193.70:0/2083309364 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff5810f230 msgr2=0x7eff5811d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff567fc6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff5810f230 0x7eff5811d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff567fc6c0 1 -- 10.20.193.70:0/2083309364 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff58122ae0 msgr2=0x7eff58122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:36.542 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff567fc6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff58122ae0 0x7eff58122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.543 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff567fc6c0 1 -- 10.20.193.70:0/2083309364 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4800a660 con 0x7eff58115440 2026-02-13T03:47:36.543 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff567fc6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 0x7eff5811d720 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff4000b6c0 tx=0x7eff4000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:36.543 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff37fff6c0 1 -- 10.20.193.70:0/2083309364 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff40004250 con 0x7eff58115440 2026-02-13T03:47:36.543 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff37fff6c0 1 -- 10.20.193.70:0/2083309364 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7eff40009070 con 0x7eff58115440 2026-02-13T03:47:36.543 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff58163cd0 con 0x7eff58115440 2026-02-13T03:47:36.543 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff37fff6c0 1 -- 10.20.193.70:0/2083309364 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff4000ccb0 con 0x7eff58115440 2026-02-13T03:47:36.543 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff58164160 con 0x7eff58115440 2026-02-13T03:47:36.543 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.538+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff58110500 con 0x7eff58115440 2026-02-13T03:47:36.544 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.540+0000 7eff37fff6c0 1 -- 10.20.193.70:0/2083309364 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7eff400028c0 con 0x7eff58115440 2026-02-13T03:47:36.544 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.541+0000 7eff37fff6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7eff2c0b5680 0x7eff2c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:36.544 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.541+0000 7eff56ffd6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7eff2c0b5680 0x7eff2c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:36.544 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.541+0000 7eff37fff6c0 1 -- 10.20.193.70:0/2083309364 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7eff400e3950 con 0x7eff58115440 2026-02-13T03:47:36.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.541+0000 7eff37fff6c0 1 -- 10.20.193.70:0/2083309364 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7eff400e3dd0 con 0x7eff58115440 2026-02-13T03:47:36.545 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.541+0000 7eff56ffd6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7eff2c0b5680 0x7eff2c0d5b30 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff4c004750 tx=0x7eff4c009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:36.665 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.664+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7eff5810f600 con 0x7eff58115440 2026-02-13T03:47:36.665 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.664+0000 7eff37fff6c0 1 -- 10.20.193.70:0/2083309364 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7eff400a63d0 con 0x7eff58115440 2026-02-13T03:47:36.666 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:36.666 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:36.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7eff2c0b5680 msgr2=0x7eff2c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:36.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7eff2c0b5680 0x7eff2c0d5b30 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff4c004750 tx=0x7eff4c009390 comp rx=0 tx=0).stop 2026-02-13T03:47:36.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 msgr2=0x7eff5811d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:36.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 0x7eff5811d720 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff4000b6c0 tx=0x7eff4000bb90 comp rx=0 tx=0).stop 2026-02-13T03:47:36.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 shutdown_connections 2026-02-13T03:47:36.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7eff2c0b5680 0x7eff2c0d5b30 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7eff58122ae0 0x7eff58122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7eff58115440 0x7eff5811d720 unknown :-1 s=CLOSED pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 --2- 10.20.193.70:0/2083309364 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff5810f230 0x7eff5811d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:36.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.665+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 >> 10.20.193.70:0/2083309364 conn(0x7eff580ecb30 msgr2=0x7eff5810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:36.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.666+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 shutdown_connections 2026-02-13T03:47:36.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:36.666+0000 7eff5d58f6c0 1 -- 10.20.193.70:0/2083309364 wait complete. 2026-02-13T03:47:37.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:37 trial177 ceph-mon[27082]: pgmap v256: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 964 B/s rd, 1 op/s 2026-02-13T03:47:37.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:37 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2083309364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:37.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:37 trial127 ceph-mon[26439]: pgmap v256: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 964 B/s rd, 1 op/s 2026-02-13T03:47:37.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:37 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2083309364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:37.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:37 trial070 ceph-mon[24757]: pgmap v256: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 964 B/s rd, 1 op/s 2026-02-13T03:47:37.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:37 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2083309364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:39.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:39 trial177 ceph-mon[27082]: pgmap v257: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:39.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:39 trial127 ceph-mon[26439]: pgmap v257: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:39.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:39 trial070 ceph-mon[24757]: pgmap v257: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:39.707 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:39.827 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:39.950 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.947+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1983430954 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410dad0 msgr2=0x7fea5410dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.947+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1983430954 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410dad0 0x7fea5410dea0 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=17065601242172927760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea44009970 tx=0x7fea4402ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.947+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1983430954 shutdown_connections 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.947+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1983430954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea5410bd00 0x7fea54175a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.947+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1983430954 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea5410b120 0x7fea5410b550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.947+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1983430954 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410dad0 0x7fea5410dea0 unknown :-1 s=CLOSED pgs=389 gs=1 cs=0 l=1 c_cookie=17065601242172927760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.947+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1983430954 >> 10.20.193.70:0/1983430954 conn(0x7fea54062e00 msgr2=0x7fea54109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.947+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1983430954 shutdown_connections 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.947+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1983430954 wait complete. 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 Processor -- start 2026-02-13T03:47:39.951 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 -- start start 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea5410b120 0x7fea540f52f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410bd00 0x7fea540f5830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea5410dad0 0x7fea540fabf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea540fb240 con 0x7fea5410bd00 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fea540fb3b0 con 0x7fea5410dad0 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fea540fb570 con 0x7fea5410b120 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea591d16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410bd00 0x7fea540f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea591d16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410bd00 0x7fea540f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:44642/0 (socket says 10.20.193.70:44642) 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea591d16c0 1 -- 10.20.193.70:0/1154404510 learned_addr learned my addr 10.20.193.70:0/1154404510 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea599d26c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea5410b120 0x7fea540f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:39.952 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea591d16c0 1 -- 10.20.193.70:0/1154404510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea5410b120 msgr2=0x7fea540f52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea591d16c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea5410b120 0x7fea540f52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea591d16c0 1 -- 10.20.193.70:0/1154404510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea5410dad0 msgr2=0x7fea540fabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea591d16c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea5410dad0 0x7fea540fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea591d16c0 1 -- 10.20.193.70:0/1154404510 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea44009590 con 0x7fea5410bd00 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea591d16c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410bd00 0x7fea540f5830 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea4800b710 tx=0x7fea4800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea42ffd6c0 1 -- 10.20.193.70:0/1154404510 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea48004250 con 0x7fea5410bd00 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea540fb850 con 0x7fea5410bd00 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea42ffd6c0 1 -- 10.20.193.70:0/1154404510 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fea48002d80 con 0x7fea5410bd00 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea42ffd6c0 1 -- 10.20.193.70:0/1154404510 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fea4800ce20 con 0x7fea5410bd00 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.948+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea54172bf0 con 0x7fea5410bd00 2026-02-13T03:47:39.953 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.949+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5410c130 con 0x7fea5410bd00 2026-02-13T03:47:39.954 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.950+0000 7fea42ffd6c0 1 -- 10.20.193.70:0/1154404510 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fea480043b0 con 0x7fea5410bd00 2026-02-13T03:47:39.954 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.951+0000 7fea42ffd6c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fea300b5600 0x7fea300d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:39.955 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.951+0000 7fea599d26c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fea300b5600 0x7fea300d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:39.955 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.952+0000 7fea42ffd6c0 1 -- 10.20.193.70:0/1154404510 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fea480e3b20 con 0x7fea5410bd00 2026-02-13T03:47:39.955 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.952+0000 7fea599d26c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fea300b5600 0x7fea300d5ab0 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea440023e0 tx=0x7fea4402f580 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:39.955 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:39.952+0000 7fea42ffd6c0 1 -- 10.20.193.70:0/1154404510 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fea480aa000 con 0x7fea5410bd00 2026-02-13T03:47:40.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.068+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fea5410b550 con 0x7fea5410bd00 2026-02-13T03:47:40.070 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.069+0000 7fea42ffd6c0 1 -- 10.20.193.70:0/1154404510 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fea48070660 con 0x7fea5410bd00 2026-02-13T03:47:40.070 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:40.070 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:40.071 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fea300b5600 msgr2=0x7fea300d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fea300b5600 0x7fea300d5ab0 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea440023e0 tx=0x7fea4402f580 comp rx=0 tx=0).stop 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410bd00 msgr2=0x7fea540f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410bd00 0x7fea540f5830 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fea4800b710 tx=0x7fea4800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 shutdown_connections 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fea300b5600 0x7fea300d5ab0 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fea5410dad0 0x7fea540fabf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fea5410bd00 0x7fea540f5830 unknown :-1 s=CLOSED pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 --2- 10.20.193.70:0/1154404510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea5410b120 0x7fea540f52f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 >> 10.20.193.70:0/1154404510 conn(0x7fea54062e00 msgr2=0x7fea540efa70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:40.072 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 shutdown_connections 2026-02-13T03:47:40.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:40.070+0000 7fea5bc616c0 1 -- 10.20.193.70:0/1154404510 wait complete. 2026-02-13T03:47:40.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:40 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1154404510' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:40.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:40 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1154404510' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:40.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:40 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1154404510' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:41.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:41 trial177 ceph-mon[27082]: pgmap v258: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:41.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:41 trial127 ceph-mon[26439]: pgmap v258: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:41.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:41 trial070 ceph-mon[24757]: pgmap v258: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:43.113 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:43.230 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:43.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 -- 10.20.193.70:0/2686917475 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10fc20 msgr2=0x7efdfc114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:43.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 --2- 10.20.193.70:0/2686917475 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10fc20 0x7efdfc114c60 secure :-1 s=READY pgs=391 gs=1 cs=0 l=1 c_cookie=6943845392627796743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efde40099a0 tx=0x7efde402ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:43.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 -- 10.20.193.70:0/2686917475 shutdown_connections 2026-02-13T03:47:43.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 --2- 10.20.193.70:0/2686917475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efdfc115440 0x7efdfc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 --2- 10.20.193.70:0/2686917475 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10fc20 0x7efdfc114c60 unknown :-1 s=CLOSED pgs=391 gs=1 cs=0 l=1 c_cookie=6943845392627796743 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 --2- 10.20.193.70:0/2686917475 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efdfc10f230 0x7efdfc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 -- 10.20.193.70:0/2686917475 >> 10.20.193.70:0/2686917475 conn(0x7efdfc0ecb30 msgr2=0x7efdfc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:43.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 -- 10.20.193.70:0/2686917475 shutdown_connections 2026-02-13T03:47:43.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 -- 10.20.193.70:0/2686917475 wait complete. 2026-02-13T03:47:43.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 Processor -- start 2026-02-13T03:47:43.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 -- start start 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10f230 0x7efdfc0f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efdfc115440 0x7efdfc175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efdfc0f5310 0x7efdfc0fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc0f5a00 con 0x7efdfc10f230 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc0faad0 con 0x7efdfc115440 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efe013b46c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc0fac90 con 0x7efdfc0f5310 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfaffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10f230 0x7efdfc0f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfaffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10f230 0x7efdfc0f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:44660/0 (socket says 10.20.193.70:44660) 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfaffd6c0 1 -- 10.20.193.70:0/681357671 learned_addr learned my addr 10.20.193.70:0/681357671 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfb7fe6c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efdfc0f5310 0x7efdfc0fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:43.356 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfa7fc6c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efdfc115440 0x7efdfc175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfaffd6c0 1 -- 10.20.193.70:0/681357671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efdfc0f5310 msgr2=0x7efdfc0fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfaffd6c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efdfc0f5310 0x7efdfc0fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfaffd6c0 1 -- 10.20.193.70:0/681357671 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efdfc115440 msgr2=0x7efdfc175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfaffd6c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efdfc115440 0x7efdfc175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfaffd6c0 1 -- 10.20.193.70:0/681357671 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde4009590 con 0x7efdfc10f230 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.351+0000 7efdfa7fc6c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efdfc115440 0x7efdfc175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.352+0000 7efdfaffd6c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10f230 0x7efdfc0f4ce0 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf000b710 tx=0x7efdf000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.352+0000 7efdd3fff6c0 1 -- 10.20.193.70:0/681357671 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf0004250 con 0x7efdfc10f230 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.352+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc0faf70 con 0x7efdfc10f230 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.352+0000 7efdd3fff6c0 1 -- 10.20.193.70:0/681357671 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7efdf0002d80 con 0x7efdfc10f230 2026-02-13T03:47:43.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.352+0000 7efdd3fff6c0 1 -- 10.20.193.70:0/681357671 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf000cda0 con 0x7efdfc10f230 2026-02-13T03:47:43.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.352+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc0fb700 con 0x7efdfc10f230 2026-02-13T03:47:43.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.352+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdfc110500 con 0x7efdfc10f230 2026-02-13T03:47:43.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.353+0000 7efdd3fff6c0 1 -- 10.20.193.70:0/681357671 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7efdf00028c0 con 0x7efdfc10f230 2026-02-13T03:47:43.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.354+0000 7efdd3fff6c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7efdcc0b5600 0x7efdcc0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:43.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.354+0000 7efdd3fff6c0 1 -- 10.20.193.70:0/681357671 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7efdf00e3b50 con 0x7efdfc10f230 2026-02-13T03:47:43.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.354+0000 7efdfa7fc6c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7efdcc0b5600 0x7efdcc0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:43.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.354+0000 7efdfa7fc6c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7efdcc0b5600 0x7efdcc0d5ab0 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efde40098c0 tx=0x7efde402f580 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:43.359 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.354+0000 7efdd3fff6c0 1 -- 10.20.193.70:0/681357671 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efdf00a65d0 con 0x7efdfc10f230 2026-02-13T03:47:43.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:43 trial177 ceph-mon[27082]: pgmap v259: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:43.473 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.472+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efdfc0f5de0 con 0x7efdfc10f230 2026-02-13T03:47:43.474 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:43 trial070 ceph-mon[24757]: pgmap v259: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:43.474 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.472+0000 7efdd3fff6c0 1 -- 10.20.193.70:0/681357671 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7efdf00a9780 con 0x7efdfc10f230 2026-02-13T03:47:43.474 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:43.475 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:43.475 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:43 trial127 ceph-mon[26439]: pgmap v259: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:43.476 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7efdcc0b5600 msgr2=0x7efdcc0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:43.476 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7efdcc0b5600 0x7efdcc0d5ab0 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efde40098c0 tx=0x7efde402f580 comp rx=0 tx=0).stop 2026-02-13T03:47:43.476 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10f230 msgr2=0x7efdfc0f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:43.476 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10f230 0x7efdfc0f4ce0 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf000b710 tx=0x7efdf000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.477 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 shutdown_connections 2026-02-13T03:47:43.477 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7efdcc0b5600 0x7efdcc0d5ab0 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.477 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efdfc0f5310 0x7efdfc0fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.477 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7efdfc115440 0x7efdfc175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.477 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 --2- 10.20.193.70:0/681357671 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7efdfc10f230 0x7efdfc0f4ce0 unknown :-1 s=CLOSED pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:43.477 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 >> 10.20.193.70:0/681357671 conn(0x7efdfc0ecb30 msgr2=0x7efdfc10d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:43.477 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 shutdown_connections 2026-02-13T03:47:43.477 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:43.474+0000 7efe013b46c0 1 -- 10.20.193.70:0/681357671 wait complete. 2026-02-13T03:47:44.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:44 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/681357671' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:44.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:44 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/681357671' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:44.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:44 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/681357671' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:45.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:45 trial177 ceph-mon[27082]: pgmap v260: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:45 trial127 ceph-mon[26439]: pgmap v260: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:45.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:45 trial070 ceph-mon[24757]: pgmap v260: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:46.517 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:46.636 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:46.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.761+0000 7fb0838d16c0 1 -- 10.20.193.70:0/3116568374 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c10f200 msgr2=0x7fb07c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:46.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.761+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/3116568374 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c10f200 0x7fb07c10f5d0 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=4146968528847625061 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb06c0099a0 tx=0x7fb06c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:46.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 -- 10.20.193.70:0/3116568374 shutdown_connections 2026-02-13T03:47:46.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/3116568374 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb07c115410 0x7fb07c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/3116568374 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb07c10fbf0 0x7fb07c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/3116568374 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c10f200 0x7fb07c10f5d0 unknown :-1 s=CLOSED pgs=393 gs=1 cs=0 l=1 c_cookie=4146968528847625061 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 -- 10.20.193.70:0/3116568374 >> 10.20.193.70:0/3116568374 conn(0x7fb07c0ecb00 msgr2=0x7fb07c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:46.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 -- 10.20.193.70:0/3116568374 shutdown_connections 2026-02-13T03:47:46.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 -- 10.20.193.70:0/3116568374 wait complete. 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 Processor -- start 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 -- start start 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb07c10f200 0x7fb07c11d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c115410 0x7fb07c11d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb07c122c50 0x7fb07c1230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c123660 con 0x7fb07c115410 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c1237d0 con 0x7fb07c10f200 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0838d16c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c123990 con 0x7fb07c122c50 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb080e416c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c115410 0x7fb07c11d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb080e416c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c115410 0x7fb07c11d890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:42802/0 (socket says 10.20.193.70:42802) 2026-02-13T03:47:46.767 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb080e416c0 1 -- 10.20.193.70:0/2340507127 learned_addr learned my addr 10.20.193.70:0/2340507127 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb081e436c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb07c122c50 0x7fb07c1230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0816426c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb07c10f200 0x7fb07c11d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb080e416c0 1 -- 10.20.193.70:0/2340507127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb07c122c50 msgr2=0x7fb07c1230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb080e416c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb07c122c50 0x7fb07c1230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb080e416c0 1 -- 10.20.193.70:0/2340507127 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb07c10f200 msgr2=0x7fb07c11d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb080e416c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb07c10f200 0x7fb07c11d350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb080e416c0 1 -- 10.20.193.70:0/2340507127 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c009590 con 0x7fb07c115410 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb081e436c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb07c122c50 0x7fb07c1230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.762+0000 7fb0816426c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb07c10f200 0x7fb07c11d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.763+0000 7fb080e416c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c115410 0x7fb07c11d890 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb070005dc0 tx=0x7fb07000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:46.768 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.763+0000 7fb06a7fc6c0 1 -- 10.20.193.70:0/2340507127 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb070004250 con 0x7fb07c115410 2026-02-13T03:47:46.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.763+0000 7fb06a7fc6c0 1 -- 10.20.193.70:0/2340507127 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb070009070 con 0x7fb07c115410 2026-02-13T03:47:46.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.763+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c163e40 con 0x7fb07c115410 2026-02-13T03:47:46.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.763+0000 7fb06a7fc6c0 1 -- 10.20.193.70:0/2340507127 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb07000cd50 con 0x7fb07c115410 2026-02-13T03:47:46.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.763+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c1642d0 con 0x7fb07c115410 2026-02-13T03:47:46.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.763+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07c1104d0 con 0x7fb07c115410 2026-02-13T03:47:46.769 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.764+0000 7fb06a7fc6c0 1 -- 10.20.193.70:0/2340507127 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fb0700028c0 con 0x7fb07c115410 2026-02-13T03:47:46.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.765+0000 7fb06a7fc6c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb0580b5600 0x7fb0580d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:46.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.765+0000 7fb06a7fc6c0 1 -- 10.20.193.70:0/2340507127 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fb0700e3b20 con 0x7fb07c115410 2026-02-13T03:47:46.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.765+0000 7fb0816426c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb0580b5600 0x7fb0580d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:46.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.765+0000 7fb0816426c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb0580b5600 0x7fb0580d5ab0 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb06c0098c0 tx=0x7fb06c02f580 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:46.770 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.765+0000 7fb06a7fc6c0 1 -- 10.20.193.70:0/2340507127 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb0700a65e0 con 0x7fb07c115410 2026-02-13T03:47:46.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.885+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb07c10f5d0 con 0x7fb07c115410 2026-02-13T03:47:46.887 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb06a7fc6c0 1 -- 10.20.193.70:0/2340507127 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb0700a9790 con 0x7fb07c115410 2026-02-13T03:47:46.887 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:46.887 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:46.888 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb0580b5600 msgr2=0x7fb0580d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:46.888 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb0580b5600 0x7fb0580d5ab0 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb06c0098c0 tx=0x7fb06c02f580 comp rx=0 tx=0).stop 2026-02-13T03:47:46.888 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c115410 msgr2=0x7fb07c11d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:46.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c115410 0x7fb07c11d890 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb070005dc0 tx=0x7fb07000bbb0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 shutdown_connections 2026-02-13T03:47:46.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb0580b5600 0x7fb0580d5ab0 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb07c122c50 0x7fb07c1230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb07c115410 0x7fb07c11d890 unknown :-1 s=CLOSED pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 --2- 10.20.193.70:0/2340507127 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb07c10f200 0x7fb07c11d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:46.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.886+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 >> 10.20.193.70:0/2340507127 conn(0x7fb07c0ecb00 msgr2=0x7fb07c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:46.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.887+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 shutdown_connections 2026-02-13T03:47:46.889 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:46.887+0000 7fb0838d16c0 1 -- 10.20.193.70:0/2340507127 wait complete. 2026-02-13T03:47:47.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:47 trial070 ceph-mon[24757]: pgmap v261: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:47.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:47 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2340507127' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:47.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:47 trial177 ceph-mon[27082]: pgmap v261: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:47.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:47 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2340507127' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:47.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:47 trial127 ceph-mon[26439]: pgmap v261: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:47.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:47 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2340507127' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:49.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:49 trial177 ceph-mon[27082]: pgmap v262: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:49.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:49 trial127 ceph-mon[26439]: pgmap v262: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:49.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:49 trial070 ceph-mon[24757]: pgmap v262: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:49.930 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:50.051 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:50.172 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.169+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/1117197533 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d9010fc20 msgr2=0x7f3d90114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:50.172 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.169+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/1117197533 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d9010fc20 0x7f3d90114c60 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=4717894761505457446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d780099a0 tx=0x7f3d7802ed20 comp rx=0 tx=0).stop 2026-02-13T03:47:50.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.169+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/1117197533 shutdown_connections 2026-02-13T03:47:50.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.169+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/1117197533 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3d90115440 0x7f3d90175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.169+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/1117197533 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d9010fc20 0x7f3d90114c60 unknown :-1 s=CLOSED pgs=395 gs=1 cs=0 l=1 c_cookie=4717894761505457446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.169+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/1117197533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d9010f230 0x7f3d9010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.169+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/1117197533 >> 10.20.193.70:0/1117197533 conn(0x7f3d900ecb30 msgr2=0x7f3d9010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:50.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.169+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/1117197533 shutdown_connections 2026-02-13T03:47:50.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.169+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/1117197533 wait complete. 2026-02-13T03:47:50.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 Processor -- start 2026-02-13T03:47:50.173 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 -- start start 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3d9010f230 0x7f3d900f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d90115440 0x7f3d90175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d900f5300 0x7f3d900fa5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d900f59f0 con 0x7f3d900f5300 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f3d900fab10 con 0x7f3d9010f230 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d900facd0 con 0x7f3d90115440 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d8f7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d900f5300 0x7f3d900fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d8f7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d900f5300 0x7f3d900fa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:42814/0 (socket says 10.20.193.70:42814) 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d8f7fe6c0 1 -- 10.20.193.70:0/2410241051 learned_addr learned my addr 10.20.193.70:0/2410241051 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d8f7fe6c0 1 -- 10.20.193.70:0/2410241051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d90115440 msgr2=0x7f3d90175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d8f7fe6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d90115440 0x7f3d90175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.174 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d8f7fe6c0 1 -- 10.20.193.70:0/2410241051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3d9010f230 msgr2=0x7f3d900f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:50.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d8f7fe6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3d9010f230 0x7f3d900f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d8f7fe6c0 1 -- 10.20.193.70:0/2410241051 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d78009590 con 0x7f3d900f5300 2026-02-13T03:47:50.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d8f7fe6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d900f5300 0x7f3d900fa5d0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d80006ea0 tx=0x7f3d8000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:50.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d6ffff6c0 1 -- 10.20.193.70:0/2410241051 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d80003a30 con 0x7f3d900f5300 2026-02-13T03:47:50.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d6ffff6c0 1 -- 10.20.193.70:0/2410241051 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3d800054f0 con 0x7f3d900f5300 2026-02-13T03:47:50.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d900fafb0 con 0x7f3d900f5300 2026-02-13T03:47:50.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d6ffff6c0 1 -- 10.20.193.70:0/2410241051 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d8000dcd0 con 0x7f3d900f5300 2026-02-13T03:47:50.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d900fb740 con 0x7f3d900f5300 2026-02-13T03:47:50.175 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.170+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d90110500 con 0x7f3d900f5300 2026-02-13T03:47:50.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.172+0000 7f3d6ffff6c0 1 -- 10.20.193.70:0/2410241051 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f3d80003b90 con 0x7f3d900f5300 2026-02-13T03:47:50.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.173+0000 7f3d6ffff6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3d640b5680 0x7f3d640d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:50.176 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.173+0000 7f3d8effd6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3d640b5680 0x7f3d640d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:50.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.173+0000 7f3d6ffff6c0 1 -- 10.20.193.70:0/2410241051 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f3d800e4a80 con 0x7f3d900f5300 2026-02-13T03:47:50.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.173+0000 7f3d8effd6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3d640b5680 0x7f3d640d5b30 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d84005980 tx=0x7f3d84005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:50.177 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.173+0000 7f3d6ffff6c0 1 -- 10.20.193.70:0/2410241051 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3d800aaf60 con 0x7f3d900f5300 2026-02-13T03:47:50.292 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.290+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3d900f5e20 con 0x7f3d900f5300 2026-02-13T03:47:50.292 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.291+0000 7f3d6ffff6c0 1 -- 10.20.193.70:0/2410241051 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3d8000de60 con 0x7f3d900f5300 2026-02-13T03:47:50.292 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:50.292 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:50.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3d640b5680 msgr2=0x7f3d640d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:50.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3d640b5680 0x7f3d640d5b30 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d84005980 tx=0x7f3d84005910 comp rx=0 tx=0).stop 2026-02-13T03:47:50.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d900f5300 msgr2=0x7f3d900fa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:50.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d900f5300 0x7f3d900fa5d0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d80006ea0 tx=0x7f3d8000cca0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 shutdown_connections 2026-02-13T03:47:50.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f3d640b5680 0x7f3d640d5b30 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f3d900f5300 0x7f3d900fa5d0 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d90115440 0x7f3d90175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 --2- 10.20.193.70:0/2410241051 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f3d9010f230 0x7f3d900f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:50.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 >> 10.20.193.70:0/2410241051 conn(0x7f3d900ecb30 msgr2=0x7f3d90113da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:50.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 shutdown_connections 2026-02-13T03:47:50.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:50.293+0000 7f3d9577b6c0 1 -- 10.20.193.70:0/2410241051 wait complete. 2026-02-13T03:47:51.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:51 trial177 ceph-mon[27082]: pgmap v263: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:51.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:51 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2410241051' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:51.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:51 trial127 ceph-mon[26439]: pgmap v263: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:51.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:51 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2410241051' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:51.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:51 trial070 ceph-mon[24757]: pgmap v263: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:51.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:51 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2410241051' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:53.336 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:53.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:53 trial177 ceph-mon[27082]: pgmap v264: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:53.458 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:53.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:53 trial127 ceph-mon[26439]: pgmap v264: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:53.480 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:53 trial070 ceph-mon[24757]: pgmap v264: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:53.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/2428730487 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc19810fbf0 msgr2=0x7fc198114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:53.579 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/2428730487 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc19810fbf0 0x7fc198114c30 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=17905093278051732313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c0098d0 tx=0x7fc18c02ec40 comp rx=0 tx=0).stop 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/2428730487 shutdown_connections 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/2428730487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc198115410 0x7fc198175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/2428730487 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc19810fbf0 0x7fc198114c30 unknown :-1 s=CLOSED pgs=397 gs=1 cs=0 l=1 c_cookie=17905093278051732313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/2428730487 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc19810f200 0x7fc19810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/2428730487 >> 10.20.193.70:0/2428730487 conn(0x7fc1980ecb00 msgr2=0x7fc19810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/2428730487 shutdown_connections 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/2428730487 wait complete. 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.576+0000 7fc19f9b96c0 1 Processor -- start 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19f9b96c0 1 -- start start 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19f9b96c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc19810f200 0x7fc1980f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:53.580 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19f9b96c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc198115410 0x7fc198175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19f9b96c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc1980f52c0 0x7fc1980fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19f9b96c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980f59b0 con 0x7fc198115410 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19f9b96c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980faad0 con 0x7fc19810f200 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19f9b96c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980fac90 con 0x7fc1980f52c0 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19cf296c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc198115410 0x7fc198175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19cf296c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc198115410 0x7fc198175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:42824/0 (socket says 10.20.193.70:42824) 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19cf296c0 1 -- 10.20.193.70:0/3432713392 learned_addr learned my addr 10.20.193.70:0/3432713392 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19df2b6c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc1980f52c0 0x7fc1980fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19cf296c0 1 -- 10.20.193.70:0/3432713392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc1980f52c0 msgr2=0x7fc1980fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19cf296c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc1980f52c0 0x7fc1980fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.581 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19cf296c0 1 -- 10.20.193.70:0/3432713392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc19810f200 msgr2=0x7fc1980f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19cf296c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc19810f200 0x7fc1980f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19cf296c0 1 -- 10.20.193.70:0/3432713392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19400a660 con 0x7fc198115410 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19df2b6c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc1980f52c0 0x7fc1980fa590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19cf296c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc198115410 0x7fc198175cb0 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c0023a0 tx=0x7fc18c02fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc1867fc6c0 1 -- 10.20.193.70:0/3432713392 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c002ae0 con 0x7fc198115410 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc1867fc6c0 1 -- 10.20.193.70:0/3432713392 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc18c005d50 con 0x7fc198115410 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c0094c0 con 0x7fc198115410 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc1867fc6c0 1 -- 10.20.193.70:0/3432713392 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc18c031030 con 0x7fc198115410 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.577+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1980fb200 con 0x7fc198115410 2026-02-13T03:47:53.582 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.578+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1980fb420 con 0x7fc198115410 2026-02-13T03:47:53.583 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.579+0000 7fc1867fc6c0 1 -- 10.20.193.70:0/3432713392 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fc18c0071c0 con 0x7fc198115410 2026-02-13T03:47:53.583 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.580+0000 7fc1867fc6c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc1740b5600 0x7fc1740d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:53.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.580+0000 7fc19d72a6c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc1740b5600 0x7fc1740d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:53.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.580+0000 7fc1867fc6c0 1 -- 10.20.193.70:0/3432713392 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fc18c107b20 con 0x7fc198115410 2026-02-13T03:47:53.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.580+0000 7fc1867fc6c0 1 -- 10.20.193.70:0/3432713392 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc18c1405e0 con 0x7fc198115410 2026-02-13T03:47:53.584 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.581+0000 7fc19d72a6c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc1740b5600 0x7fc1740d5ab0 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc188004750 tx=0x7fc1880096a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:53.700 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.698+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc1981104d0 con 0x7fc198115410 2026-02-13T03:47:53.700 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.699+0000 7fc1867fc6c0 1 -- 10.20.193.70:0/3432713392 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc18c0ca5a0 con 0x7fc198115410 2026-02-13T03:47:53.700 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:53.700 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:53.701 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc1740b5600 msgr2=0x7fc1740d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:53.701 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc1740b5600 0x7fc1740d5ab0 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc188004750 tx=0x7fc1880096a0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.701 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc198115410 msgr2=0x7fc198175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:53.701 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc198115410 0x7fc198175cb0 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18c0023a0 tx=0x7fc18c02fb20 comp rx=0 tx=0).stop 2026-02-13T03:47:53.702 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 shutdown_connections 2026-02-13T03:47:53.702 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc1740b5600 0x7fc1740d5ab0 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.702 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc1980f52c0 0x7fc1980fa590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.702 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc198115410 0x7fc198175cb0 unknown :-1 s=CLOSED pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.702 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 --2- 10.20.193.70:0/3432713392 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc19810f200 0x7fc1980f4c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:53.702 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 >> 10.20.193.70:0/3432713392 conn(0x7fc1980ecb00 msgr2=0x7fc198111bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:53.702 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 shutdown_connections 2026-02-13T03:47:53.702 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:53.700+0000 7fc19f9b96c0 1 -- 10.20.193.70:0/3432713392 wait complete. 2026-02-13T03:47:54.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:54 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3432713392' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:54 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3432713392' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:54 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3432713392' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:55.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:55 trial177 ceph-mon[27082]: pgmap v265: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:55.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:55 trial127 ceph-mon[26439]: pgmap v265: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:55.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:55 trial070 ceph-mon[24757]: pgmap v265: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:56.740 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:47:56.861 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:47:56.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.971+0000 7f01bcd356c0 1 -- 10.20.193.70:0/2967159432 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b810d970 msgr2=0x7f01b81129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:56.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.971+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/2967159432 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b810d970 0x7f01b81129b0 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=3647498602079897124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01a00099a0 tx=0x7f01a002ed50 comp rx=0 tx=0).stop 2026-02-13T03:47:56.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 -- 10.20.193.70:0/2967159432 shutdown_connections 2026-02-13T03:47:56.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/2967159432 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01b8113190 0x7f01b8173b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:56.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/2967159432 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b810d970 0x7f01b81129b0 unknown :-1 s=CLOSED pgs=399 gs=1 cs=0 l=1 c_cookie=3647498602079897124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:56.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/2967159432 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01b810cf80 0x7f01b810d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:56.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 -- 10.20.193.70:0/2967159432 >> 10.20.193.70:0/2967159432 conn(0x7f01b80ea880 msgr2=0x7f01b810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:56.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 -- 10.20.193.70:0/2967159432 shutdown_connections 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 -- 10.20.193.70:0/2967159432 wait complete. 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 Processor -- start 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 -- start start 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01b810cf80 0x7f01b80f4ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01b8113190 0x7f01b8173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b80f52d0 0x7f01b80fa5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01b80f5930 con 0x7f01b80f52d0 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f01b80faae0 con 0x7f01b8113190 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01bcd356c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01b80faca0 con 0x7f01b810cf80 2026-02-13T03:47:56.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b6d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b80f52d0 0x7f01b80fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:56.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b6d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b80f52d0 0x7f01b80fa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:47620/0 (socket says 10.20.193.70:47620) 2026-02-13T03:47:56.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b6d766c0 1 -- 10.20.193.70:0/614850242 learned_addr learned my addr 10.20.193.70:0/614850242 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:47:56.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b5d746c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01b8113190 0x7f01b8173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:56.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b6d766c0 1 -- 10.20.193.70:0/614850242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01b810cf80 msgr2=0x7f01b80f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:56.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b6d766c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01b810cf80 0x7f01b80f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:56.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b6d766c0 1 -- 10.20.193.70:0/614850242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01b8113190 msgr2=0x7f01b8173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:56.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b6d766c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01b8113190 0x7f01b8173a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:56.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b6d766c0 1 -- 10.20.193.70:0/614850242 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a0009590 con 0x7f01b80f52d0 2026-02-13T03:47:56.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.972+0000 7f01b6d766c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b80f52d0 0x7f01b80fa5a0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01a800c730 tx=0x7f01a800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:56.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.973+0000 7f019f7fe6c0 1 -- 10.20.193.70:0/614850242 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01a8003c40 con 0x7f01b80f52d0 2026-02-13T03:47:56.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.973+0000 7f019f7fe6c0 1 -- 10.20.193.70:0/614850242 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f01a800a070 con 0x7f01b80f52d0 2026-02-13T03:47:56.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.973+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b80faf20 con 0x7f01b80f52d0 2026-02-13T03:47:56.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.973+0000 7f019f7fe6c0 1 -- 10.20.193.70:0/614850242 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01a800dca0 con 0x7f01b80f52d0 2026-02-13T03:47:56.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.973+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b80fb710 con 0x7f01b80f52d0 2026-02-13T03:47:56.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.973+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b80fb450 con 0x7f01b80f52d0 2026-02-13T03:47:56.980 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.974+0000 7f019f7fe6c0 1 -- 10.20.193.70:0/614850242 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f01a8005030 con 0x7f01b80f52d0 2026-02-13T03:47:56.980 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.975+0000 7f019f7fe6c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01900b5680 0x7f01900d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:47:56.980 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.975+0000 7f01b65756c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01900b5680 0x7f01900d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:47:56.981 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.975+0000 7f019f7fe6c0 1 -- 10.20.193.70:0/614850242 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f01a80e48f0 con 0x7f01b80f52d0 2026-02-13T03:47:56.981 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.976+0000 7f019f7fe6c0 1 -- 10.20.193.70:0/614850242 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f01a80e4d70 con 0x7f01b80f52d0 2026-02-13T03:47:56.981 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:56.976+0000 7f01b65756c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01900b5680 0x7f01900d5b30 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01ac004750 tx=0x7f01ac005cb0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:47:57.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.092+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f01b80fb450 con 0x7f01b80f52d0 2026-02-13T03:47:57.095 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.093+0000 7f019f7fe6c0 1 -- 10.20.193.70:0/614850242 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f01b80fb450 con 0x7f01b80f52d0 2026-02-13T03:47:57.095 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:47:57.095 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:47:57.096 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.093+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01900b5680 msgr2=0x7f01900d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:57.096 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.093+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01900b5680 0x7f01900d5b30 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01ac004750 tx=0x7f01ac005cb0 comp rx=0 tx=0).stop 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.093+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b80f52d0 msgr2=0x7f01b80fa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.093+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b80f52d0 0x7f01b80fa5a0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01a800c730 tx=0x7f01a800cc00 comp rx=0 tx=0).stop 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.094+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 shutdown_connections 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.094+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01900b5680 0x7f01900d5b30 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.094+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f01b80f52d0 0x7f01b80fa5a0 unknown :-1 s=CLOSED pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.094+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f01b8113190 0x7f01b8173a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.094+0000 7f01bcd356c0 1 --2- 10.20.193.70:0/614850242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01b810cf80 0x7f01b80f4ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.094+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 >> 10.20.193.70:0/614850242 conn(0x7f01b80ea880 msgr2=0x7f01b81119b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.094+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 shutdown_connections 2026-02-13T03:47:57.097 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:47:57.094+0000 7f01bcd356c0 1 -- 10.20.193.70:0/614850242 wait complete. 2026-02-13T03:47:57.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:57 trial177 ceph-mon[27082]: pgmap v266: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:57.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:57 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/614850242' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:57.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:57 trial127 ceph-mon[26439]: pgmap v266: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:57.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:57 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/614850242' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:57.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:57 trial070 ceph-mon[24757]: pgmap v266: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:47:57.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:57 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/614850242' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:47:59.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:47:59 trial177 ceph-mon[27082]: pgmap v267: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:47:59 trial127 ceph-mon[26439]: pgmap v267: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:47:59.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:47:59 trial070 ceph-mon[24757]: pgmap v267: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:00.141 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:00.263 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:00.389 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 -- 10.20.193.70:0/3901236799 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd268115440 msgr2=0x7fd268175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/3901236799 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd268115440 0x7fd268175de0 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=10454850223126947581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd26400aa70 tx=0x7fd26402fde0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 -- 10.20.193.70:0/3901236799 shutdown_connections 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/3901236799 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd268115440 0x7fd268175de0 unknown :-1 s=CLOSED pgs=401 gs=1 cs=0 l=1 c_cookie=10454850223126947581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/3901236799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd26810fc20 0x7fd268114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/3901236799 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd26810f230 0x7fd26810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 -- 10.20.193.70:0/3901236799 >> 10.20.193.70:0/3901236799 conn(0x7fd2680ecb30 msgr2=0x7fd26810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 -- 10.20.193.70:0/3901236799 shutdown_connections 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 -- 10.20.193.70:0/3901236799 wait complete. 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.385+0000 7fd26fd216c0 1 Processor -- start 2026-02-13T03:48:00.390 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26fd216c0 1 -- start start 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26fd216c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd26810f230 0x7fd26811d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26fd216c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd268115440 0x7fd26811d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26fd216c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd268122ae0 0x7fd268122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26fd216c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2681234f0 con 0x7fd26810f230 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26fd216c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd268123660 con 0x7fd268122ae0 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26fd216c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd268123820 con 0x7fd268115440 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26da926c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd26810f230 0x7fd26811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26da926c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd26810f230 0x7fd26811d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:47630/0 (socket says 10.20.193.70:47630) 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26da926c0 1 -- 10.20.193.70:0/2530332376 learned_addr learned my addr 10.20.193.70:0/2530332376 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26d2916c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd268115440 0x7fd26811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:00.391 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26e2936c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd268122ae0 0x7fd268122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26da926c0 1 -- 10.20.193.70:0/2530332376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd268115440 msgr2=0x7fd26811d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26da926c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd268115440 0x7fd26811d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26da926c0 1 -- 10.20.193.70:0/2530332376 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd268122ae0 msgr2=0x7fd268122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26da926c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd268122ae0 0x7fd268122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26da926c0 1 -- 10.20.193.70:0/2530332376 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26400a660 con 0x7fd26810f230 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26e2936c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd268122ae0 0x7fd268122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26d2916c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd268115440 0x7fd26811d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26da926c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd26810f230 0x7fd26811d1e0 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd258009490 tx=0x7fd25800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd256ffd6c0 1 -- 10.20.193.70:0/2530332376 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd258004a80 con 0x7fd26810f230 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd256ffd6c0 1 -- 10.20.193.70:0/2530332376 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd258009030 con 0x7fd26810f230 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd268163cd0 con 0x7fd26810f230 2026-02-13T03:48:00.392 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd256ffd6c0 1 -- 10.20.193.70:0/2530332376 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd25800ce30 con 0x7fd26810f230 2026-02-13T03:48:00.393 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.386+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd268164160 con 0x7fd26810f230 2026-02-13T03:48:00.393 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.387+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd268110500 con 0x7fd26810f230 2026-02-13T03:48:00.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.388+0000 7fd256ffd6c0 1 -- 10.20.193.70:0/2530332376 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fd258004060 con 0x7fd26810f230 2026-02-13T03:48:00.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.389+0000 7fd256ffd6c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2440b5600 0x7fd2440d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:00.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.389+0000 7fd256ffd6c0 1 -- 10.20.193.70:0/2530332376 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fd2580e3b60 con 0x7fd26810f230 2026-02-13T03:48:00.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.389+0000 7fd26d2916c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2440b5600 0x7fd2440d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:00.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.389+0000 7fd26d2916c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2440b5600 0x7fd2440d5ab0 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd268123b70 tx=0x7fd25c005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:00.394 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.389+0000 7fd256ffd6c0 1 -- 10.20.193.70:0/2530332376 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd2580a65e0 con 0x7fd26810f230 2026-02-13T03:48:00.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.508+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd26810f600 con 0x7fd26810f230 2026-02-13T03:48:00.510 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.508+0000 7fd256ffd6c0 1 -- 10.20.193.70:0/2530332376 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd2580a9790 con 0x7fd26810f230 2026-02-13T03:48:00.511 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:00.511 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:00.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2440b5600 msgr2=0x7fd2440d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:00.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2440b5600 0x7fd2440d5ab0 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd268123b70 tx=0x7fd25c005f10 comp rx=0 tx=0).stop 2026-02-13T03:48:00.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd26810f230 msgr2=0x7fd26811d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:00.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd26810f230 0x7fd26811d1e0 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd258009490 tx=0x7fd25800bca0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 shutdown_connections 2026-02-13T03:48:00.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd2440b5600 0x7fd2440d5ab0 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd268122ae0 0x7fd268122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.512 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd268115440 0x7fd26811d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 --2- 10.20.193.70:0/2530332376 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd26810f230 0x7fd26811d1e0 unknown :-1 s=CLOSED pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:00.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 >> 10.20.193.70:0/2530332376 conn(0x7fd2680ecb30 msgr2=0x7fd26810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:00.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 shutdown_connections 2026-02-13T03:48:00.513 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:00.509+0000 7fd26fd216c0 1 -- 10.20.193.70:0/2530332376 wait complete. 2026-02-13T03:48:01.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:01 trial177 ceph-mon[27082]: pgmap v268: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:01.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:01 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2530332376' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:01.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:01 trial127 ceph-mon[26439]: pgmap v268: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:01.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:01 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2530332376' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:01.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:01 trial070 ceph-mon[24757]: pgmap v268: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:01.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:01 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2530332376' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:03.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:03 trial177 ceph-mon[27082]: pgmap v269: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:03.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:03 trial127 ceph-mon[26439]: pgmap v269: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:03.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:03 trial070 ceph-mon[24757]: pgmap v269: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:03.555 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:03.672 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:03.791 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 -- 10.20.193.70:0/179726863 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10fc20 msgr2=0x7f596c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:03.791 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 --2- 10.20.193.70:0/179726863 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10fc20 0x7f596c114c60 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=6263636201273326792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59600099a0 tx=0x7f596002ed50 comp rx=0 tx=0).stop 2026-02-13T03:48:03.791 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 -- 10.20.193.70:0/179726863 shutdown_connections 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 --2- 10.20.193.70:0/179726863 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f596c115440 0x7f596c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 --2- 10.20.193.70:0/179726863 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10fc20 0x7f596c114c60 unknown :-1 s=CLOSED pgs=403 gs=1 cs=0 l=1 c_cookie=6263636201273326792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 --2- 10.20.193.70:0/179726863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f596c10f230 0x7f596c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 -- 10.20.193.70:0/179726863 >> 10.20.193.70:0/179726863 conn(0x7f596c0ecb30 msgr2=0x7f596c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 -- 10.20.193.70:0/179726863 shutdown_connections 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 -- 10.20.193.70:0/179726863 wait complete. 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 Processor -- start 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.787+0000 7f5973c416c0 1 -- start start 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f5973c416c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10f230 0x7f596c0f4c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:03.792 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f5973c416c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f596c115440 0x7f596c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f5973c416c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f596c0f5290 0x7f596c0fa560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f5973c416c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0f58f0 con 0x7f596c10f230 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f5973c416c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0faaa0 con 0x7f596c115440 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f5973c416c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0fac60 con 0x7f596c0f5290 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59719b26c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10f230 0x7f596c0f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59719b26c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10f230 0x7f596c0f4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:47640/0 (socket says 10.20.193.70:47640) 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59719b26c0 1 -- 10.20.193.70:0/3678654423 learned_addr learned my addr 10.20.193.70:0/3678654423 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59711b16c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f596c115440 0x7f596c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59721b36c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f596c0f5290 0x7f596c0fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59719b26c0 1 -- 10.20.193.70:0/3678654423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f596c0f5290 msgr2=0x7f596c0fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59719b26c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f596c0f5290 0x7f596c0fa560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.793 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59719b26c0 1 -- 10.20.193.70:0/3678654423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f596c115440 msgr2=0x7f596c175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59719b26c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f596c115440 0x7f596c175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59719b26c0 1 -- 10.20.193.70:0/3678654423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5960009590 con 0x7f596c10f230 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59721b36c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f596c0f5290 0x7f596c0fa560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f59719b26c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10f230 0x7f596c0f4c60 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f595c00b710 tx=0x7f595c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f595affd6c0 1 -- 10.20.193.70:0/3678654423 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f595c004250 con 0x7f596c10f230 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c0faee0 con 0x7f596c10f230 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f595affd6c0 1 -- 10.20.193.70:0/3678654423 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f595c002d80 con 0x7f596c10f230 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f595affd6c0 1 -- 10.20.193.70:0/3678654423 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f595c00cdc0 con 0x7f596c10f230 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c0fb6d0 con 0x7f596c10f230 2026-02-13T03:48:03.794 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.788+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c110500 con 0x7f596c10f230 2026-02-13T03:48:03.795 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.790+0000 7f595affd6c0 1 -- 10.20.193.70:0/3678654423 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f595c0028c0 con 0x7f596c10f230 2026-02-13T03:48:03.795 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.791+0000 7f595affd6c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f59480b5600 0x7f59480d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:03.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.791+0000 7f59711b16c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f59480b5600 0x7f59480d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:03.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.791+0000 7f595affd6c0 1 -- 10.20.193.70:0/3678654423 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f595c0e3b60 con 0x7f596c10f230 2026-02-13T03:48:03.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.791+0000 7f595affd6c0 1 -- 10.20.193.70:0/3678654423 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f595c0a6620 con 0x7f596c10f230 2026-02-13T03:48:03.796 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.791+0000 7f59711b16c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f59480b5600 0x7f59480d5ab0 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59600023e0 tx=0x7f5960005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:03.912 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.910+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f596c0f5db0 con 0x7f596c10f230 2026-02-13T03:48:03.912 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.910+0000 7f595affd6c0 1 -- 10.20.193.70:0/3678654423 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f595c0a97d0 con 0x7f596c10f230 2026-02-13T03:48:03.912 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:03.912 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:03.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f59480b5600 msgr2=0x7f59480d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:03.913 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f59480b5600 0x7f59480d5ab0 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59600023e0 tx=0x7f5960005c20 comp rx=0 tx=0).stop 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10f230 msgr2=0x7f596c0f4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10f230 0x7f596c0f4c60 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f595c00b710 tx=0x7f595c00bbe0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 shutdown_connections 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f59480b5600 0x7f59480d5ab0 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f596c0f5290 0x7f596c0fa560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f596c115440 0x7f596c175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 --2- 10.20.193.70:0/3678654423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f596c10f230 0x7f596c0f4c60 unknown :-1 s=CLOSED pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 >> 10.20.193.70:0/3678654423 conn(0x7f596c0ecb30 msgr2=0x7f596c10d930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 shutdown_connections 2026-02-13T03:48:03.914 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:03.911+0000 7f5973c416c0 1 -- 10.20.193.70:0/3678654423 wait complete. 2026-02-13T03:48:04.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:04 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3678654423' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:04.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:04 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3678654423' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:04 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3678654423' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:05.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:05 trial177 ceph-mon[27082]: pgmap v270: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:05 trial127 ceph-mon[26439]: pgmap v270: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:05.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:05 trial070 ceph-mon[24757]: pgmap v270: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:06.956 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:07.074 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:07.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.194+0000 7f006baa86c0 1 -- 10.20.193.70:0/1999798352 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f006410fc20 msgr2=0x7f0064114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:07.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.194+0000 7f006baa86c0 1 --2- 10.20.193.70:0/1999798352 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f006410fc20 0x7f0064114c60 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=8163247069299123690 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00580099a0 tx=0x7f005802ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:07.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.194+0000 7f006baa86c0 1 -- 10.20.193.70:0/1999798352 shutdown_connections 2026-02-13T03:48:07.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.194+0000 7f006baa86c0 1 --2- 10.20.193.70:0/1999798352 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0064115440 0x7f0064175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.194+0000 7f006baa86c0 1 --2- 10.20.193.70:0/1999798352 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f006410fc20 0x7f0064114c60 unknown :-1 s=CLOSED pgs=405 gs=1 cs=0 l=1 c_cookie=8163247069299123690 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.194+0000 7f006baa86c0 1 --2- 10.20.193.70:0/1999798352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f006410f230 0x7f006410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.199 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.194+0000 7f006baa86c0 1 -- 10.20.193.70:0/1999798352 >> 10.20.193.70:0/1999798352 conn(0x7f00640ecb30 msgr2=0x7f006410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.194+0000 7f006baa86c0 1 -- 10.20.193.70:0/1999798352 shutdown_connections 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.194+0000 7f006baa86c0 1 -- 10.20.193.70:0/1999798352 wait complete. 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 Processor -- start 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 -- start start 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f006410f230 0x7f00640f4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0064115440 0x7f0064175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00640f5330 0x7f00640fa5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00640f5a20 con 0x7f00640f5330 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f00640faaf0 con 0x7f006410f230 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f00640facb0 con 0x7f0064115440 2026-02-13T03:48:07.200 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006a01e6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00640f5330 0x7f00640fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006a01e6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00640f5330 0x7f00640fa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:47406/0 (socket says 10.20.193.70:47406) 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006a01e6c0 1 -- 10.20.193.70:0/3241802574 learned_addr learned my addr 10.20.193.70:0/3241802574 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006981d6c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f006410f230 0x7f00640f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006a01e6c0 1 -- 10.20.193.70:0/3241802574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0064115440 msgr2=0x7f0064175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006a01e6c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0064115440 0x7f0064175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006a01e6c0 1 -- 10.20.193.70:0/3241802574 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f006410f230 msgr2=0x7f00640f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006a01e6c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f006410f230 0x7f00640f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006a01e6c0 1 -- 10.20.193.70:0/3241802574 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0058009590 con 0x7f00640f5330 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006a01e6c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00640f5330 0x7f00640fa5b0 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0060006ea0 tx=0x7f006000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f0052ffd6c0 1 -- 10.20.193.70:0/3241802574 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0060003a30 con 0x7f00640f5330 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f0052ffd6c0 1 -- 10.20.193.70:0/3241802574 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f00600054f0 con 0x7f00640f5330 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00640faf90 con 0x7f00640f5330 2026-02-13T03:48:07.201 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f0052ffd6c0 1 -- 10.20.193.70:0/3241802574 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f006000dcd0 con 0x7f00640f5330 2026-02-13T03:48:07.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.195+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00640fb720 con 0x7f00640f5330 2026-02-13T03:48:07.202 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.196+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00640fb470 con 0x7f00640f5330 2026-02-13T03:48:07.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.197+0000 7f0052ffd6c0 1 -- 10.20.193.70:0/3241802574 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f0060003b90 con 0x7f00640f5330 2026-02-13T03:48:07.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.198+0000 7f0052ffd6c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00400b5600 0x7f00400d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:07.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.198+0000 7f006981d6c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00400b5600 0x7f00400d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:07.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.198+0000 7f0052ffd6c0 1 -- 10.20.193.70:0/3241802574 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f00600e4b00 con 0x7f00640f5330 2026-02-13T03:48:07.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.198+0000 7f0052ffd6c0 1 -- 10.20.193.70:0/3241802574 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00600aa730 con 0x7f00640f5330 2026-02-13T03:48:07.203 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.198+0000 7f006981d6c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00400b5600 0x7f00400d5ab0 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0054005980 tx=0x7f0054005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:07.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:07 trial070 ceph-mon[24757]: pgmap v271: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:07.318 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.316+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f00640f5e00 con 0x7f00640f5330 2026-02-13T03:48:07.318 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.316+0000 7f0052ffd6c0 1 -- 10.20.193.70:0/3241802574 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f00600aa910 con 0x7f00640f5330 2026-02-13T03:48:07.318 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:07.318 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:07.319 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00400b5600 msgr2=0x7f00400d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:07.319 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00400b5600 0x7f00400d5ab0 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0054005980 tx=0x7f0054005910 comp rx=0 tx=0).stop 2026-02-13T03:48:07.319 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00640f5330 msgr2=0x7f00640fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:07.319 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00640f5330 0x7f00640fa5b0 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0060006ea0 tx=0x7f006000cca0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.320 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 shutdown_connections 2026-02-13T03:48:07.320 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f00400b5600 0x7f00400d5ab0 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.320 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f00640f5330 0x7f00640fa5b0 unknown :-1 s=CLOSED pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.320 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0064115440 0x7f0064175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.320 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 --2- 10.20.193.70:0/3241802574 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f006410f230 0x7f00640f4d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:07.320 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 >> 10.20.193.70:0/3241802574 conn(0x7f00640ecb30 msgr2=0x7f006410d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:07.320 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 shutdown_connections 2026-02-13T03:48:07.320 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:07.317+0000 7f006baa86c0 1 -- 10.20.193.70:0/3241802574 wait complete. 2026-02-13T03:48:07.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:07 trial177 ceph-mon[27082]: pgmap v271: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:07.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:07 trial127 ceph-mon[26439]: pgmap v271: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:08.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:08 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3241802574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:08.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:08 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3241802574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:08.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:08 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3241802574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:09.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:09 trial177 ceph-mon[27082]: pgmap v272: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:09.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:09 trial127 ceph-mon[26439]: pgmap v272: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:09.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:09 trial070 ceph-mon[24757]: pgmap v272: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:10.359 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:10.478 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:10.601 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 -- 10.20.193.70:0/2640924322 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c10f230 msgr2=0x7f398c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:10.601 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 --2- 10.20.193.70:0/2640924322 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c10f230 0x7f398c10f600 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=11426986440601719413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39800099a0 tx=0x7f398002ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:10.601 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 -- 10.20.193.70:0/2640924322 shutdown_connections 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 --2- 10.20.193.70:0/2640924322 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f398c115440 0x7f398c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 --2- 10.20.193.70:0/2640924322 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f398c10fc20 0x7f398c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 --2- 10.20.193.70:0/2640924322 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c10f230 0x7f398c10f600 unknown :-1 s=CLOSED pgs=407 gs=1 cs=0 l=1 c_cookie=11426986440601719413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 -- 10.20.193.70:0/2640924322 >> 10.20.193.70:0/2640924322 conn(0x7f398c0ecb30 msgr2=0x7f398c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 -- 10.20.193.70:0/2640924322 shutdown_connections 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 -- 10.20.193.70:0/2640924322 wait complete. 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 Processor -- start 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.597+0000 7f39915586c0 1 -- start start 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f39915586c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f398c10f230 0x7f398c11d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:10.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f39915586c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f398c115440 0x7f398c11d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f39915586c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c122c80 0x7f398c123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f39915586c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f398c123690 con 0x7f398c122c80 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f39915586c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f398c123800 con 0x7f398c115440 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f39915586c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1239c0 con 0x7f398c10f230 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398b7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c122c80 0x7f398c123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398b7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c122c80 0x7f398c123120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:47426/0 (socket says 10.20.193.70:47426) 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398b7fe6c0 1 -- 10.20.193.70:0/1372317585 learned_addr learned my addr 10.20.193.70:0/1372317585 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398affd6c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f398c10f230 0x7f398c11d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398a7fc6c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f398c115440 0x7f398c11d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398b7fe6c0 1 -- 10.20.193.70:0/1372317585 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f398c10f230 msgr2=0x7f398c11d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398b7fe6c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f398c10f230 0x7f398c11d380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398b7fe6c0 1 -- 10.20.193.70:0/1372317585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f398c115440 msgr2=0x7f398c11d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398b7fe6c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f398c115440 0x7f398c11d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398b7fe6c0 1 -- 10.20.193.70:0/1372317585 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3980009590 con 0x7f398c122c80 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398a7fc6c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f398c115440 0x7f398c11d8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f398b7fe6c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c122c80 0x7f398c123120 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f397c006ea0 tx=0x7f397c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f396bfff6c0 1 -- 10.20.193.70:0/1372317585 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f397c003a30 con 0x7f398c122c80 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c163e70 con 0x7f398c122c80 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f396bfff6c0 1 -- 10.20.193.70:0/1372317585 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f397c0054f0 con 0x7f398c122c80 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c164350 con 0x7f398c122c80 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f396bfff6c0 1 -- 10.20.193.70:0/1372317585 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f397c00dcd0 con 0x7f398c122c80 2026-02-13T03:48:10.604 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.598+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398c110500 con 0x7f398c122c80 2026-02-13T03:48:10.605 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.600+0000 7f396bfff6c0 1 -- 10.20.193.70:0/1372317585 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f397c005030 con 0x7f398c122c80 2026-02-13T03:48:10.605 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.601+0000 7f396bfff6c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f39600b5680 0x7f39600d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:10.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.601+0000 7f398affd6c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f39600b5680 0x7f39600d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:10.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.601+0000 7f396bfff6c0 1 -- 10.20.193.70:0/1372317585 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f397c0e4ae0 con 0x7f398c122c80 2026-02-13T03:48:10.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.601+0000 7f396bfff6c0 1 -- 10.20.193.70:0/1372317585 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f397c11d5e0 con 0x7f398c122c80 2026-02-13T03:48:10.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.601+0000 7f398affd6c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f39600b5680 0x7f39600d5b30 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39800023e0 tx=0x7f398002f580 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:10.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.720+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f398c11e500 con 0x7f398c122c80 2026-02-13T03:48:10.722 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.720+0000 7f396bfff6c0 1 -- 10.20.193.70:0/1372317585 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f397c0a75a0 con 0x7f398c122c80 2026-02-13T03:48:10.723 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:10.723 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:10.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f39600b5680 msgr2=0x7f39600d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:10.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f39600b5680 0x7f39600d5b30 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39800023e0 tx=0x7f398002f580 comp rx=0 tx=0).stop 2026-02-13T03:48:10.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c122c80 msgr2=0x7f398c123120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:10.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c122c80 0x7f398c123120 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f397c006ea0 tx=0x7f397c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 shutdown_connections 2026-02-13T03:48:10.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f39600b5680 0x7f39600d5b30 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f398c122c80 0x7f398c123120 unknown :-1 s=CLOSED pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f398c115440 0x7f398c11d8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 --2- 10.20.193.70:0/1372317585 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f398c10f230 0x7f398c11d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:10.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 >> 10.20.193.70:0/1372317585 conn(0x7f398c0ecb30 msgr2=0x7f398c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:10.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 shutdown_connections 2026-02-13T03:48:10.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:10.721+0000 7f39915586c0 1 -- 10.20.193.70:0/1372317585 wait complete. 2026-02-13T03:48:11.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:11 trial177 ceph-mon[27082]: pgmap v273: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:11.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:11 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1372317585' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:11.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:11 trial127 ceph-mon[26439]: pgmap v273: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:11.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:11 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1372317585' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:11.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:11 trial070 ceph-mon[24757]: pgmap v273: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:11.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:11 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1372317585' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:13.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:13 trial177 ceph-mon[27082]: pgmap v274: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:13.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:13 trial127 ceph-mon[26439]: pgmap v274: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:13.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:13 trial070 ceph-mon[24757]: pgmap v274: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:13.765 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:13.883 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:14.003 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 -- 10.20.193.70:0/4130463261 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 msgr2=0x7f625410e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:14.003 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 --2- 10.20.193.70:0/4130463261 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 0x7f625410e130 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=13860943450214302551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6244009970 tx=0x7f624402ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:14.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 -- 10.20.193.70:0/4130463261 shutdown_connections 2026-02-13T03:48:14.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 --2- 10.20.193.70:0/4130463261 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6254153310 0x7f6254173730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 --2- 10.20.193.70:0/4130463261 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f625410e750 0x7f6254152dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 --2- 10.20.193.70:0/4130463261 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 0x7f625410e130 unknown :-1 s=CLOSED pgs=409 gs=1 cs=0 l=1 c_cookie=13860943450214302551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 -- 10.20.193.70:0/4130463261 >> 10.20.193.70:0/4130463261 conn(0x7f62540e9770 msgr2=0x7f6254109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:14.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 -- 10.20.193.70:0/4130463261 shutdown_connections 2026-02-13T03:48:14.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 -- 10.20.193.70:0/4130463261 wait complete. 2026-02-13T03:48:14.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 Processor -- start 2026-02-13T03:48:14.004 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:13.999+0000 7f625b5406c0 1 -- start start 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f625b5406c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 0x7f625410bbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f625b5406c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f625410e750 0x7f625410c130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f625b5406c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6254153310 0x7f625410c670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f625b5406c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f625414ee20 con 0x7f625410dd60 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f625b5406c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f625414ef90 con 0x7f625410e750 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f625b5406c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f625414f150 con 0x7f6254153310 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62592b16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 0x7f625410bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62592b16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 0x7f625410bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:47442/0 (socket says 10.20.193.70:47442) 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62592b16c0 1 -- 10.20.193.70:0/2261230430 learned_addr learned my addr 10.20.193.70:0/2261230430 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f6258ab06c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f625410e750 0x7f625410c130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f6259ab26c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6254153310 0x7f625410c670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:14.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62592b16c0 1 -- 10.20.193.70:0/2261230430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6254153310 msgr2=0x7f625410c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62592b16c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6254153310 0x7f625410c670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62592b16c0 1 -- 10.20.193.70:0/2261230430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f625410e750 msgr2=0x7f625410c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62592b16c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f625410e750 0x7f625410c130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62592b16c0 1 -- 10.20.193.70:0/2261230430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6244009590 con 0x7f625410dd60 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f6259ab26c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6254153310 0x7f625410c670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62592b16c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 0x7f625410bbf0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62440092b0 tx=0x7f624402fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62427fc6c0 1 -- 10.20.193.70:0/2261230430 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6244002ba0 con 0x7f625410dd60 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62427fc6c0 1 -- 10.20.193.70:0/2261230430 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6244002d00 con 0x7f625410dd60 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625414f3d0 con 0x7f625410dd60 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f62427fc6c0 1 -- 10.20.193.70:0/2261230430 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f62440382f0 con 0x7f625410dd60 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.000+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625414f8a0 con 0x7f625410dd60 2026-02-13T03:48:14.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.001+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625405faf0 con 0x7f625410dd60 2026-02-13T03:48:14.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.002+0000 7f62427fc6c0 1 -- 10.20.193.70:0/2261230430 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f62440071c0 con 0x7f625410dd60 2026-02-13T03:48:14.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.002+0000 7f62427fc6c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f62300b5680 0x7f62300d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:14.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.003+0000 7f6258ab06c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f62300b5680 0x7f62300d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:14.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.003+0000 7f62427fc6c0 1 -- 10.20.193.70:0/2261230430 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f6244107cb0 con 0x7f625410dd60 2026-02-13T03:48:14.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.003+0000 7f6258ab06c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f62300b5680 0x7f62300d5b30 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6248005980 tx=0x7f6248005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:14.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.003+0000 7f62427fc6c0 1 -- 10.20.193.70:0/2261230430 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f62440ca770 con 0x7f625410dd60 2026-02-13T03:48:14.122 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.120+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f625410e130 con 0x7f625410dd60 2026-02-13T03:48:14.123 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.121+0000 7f62427fc6c0 1 -- 10.20.193.70:0/2261230430 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f62440cd920 con 0x7f625410dd60 2026-02-13T03:48:14.123 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:14.123 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:14.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f62300b5680 msgr2=0x7f62300d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:14.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f62300b5680 0x7f62300d5b30 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6248005980 tx=0x7f6248005910 comp rx=0 tx=0).stop 2026-02-13T03:48:14.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 msgr2=0x7f625410bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:14.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 0x7f625410bbf0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62440092b0 tx=0x7f624402fca0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 shutdown_connections 2026-02-13T03:48:14.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f62300b5680 0x7f62300d5b30 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6254153310 0x7f625410c670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f625410e750 0x7f625410c130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 --2- 10.20.193.70:0/2261230430 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f625410dd60 0x7f625410bbf0 unknown :-1 s=CLOSED pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:14.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 >> 10.20.193.70:0/2261230430 conn(0x7f62540e9770 msgr2=0x7f6254109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:14.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 shutdown_connections 2026-02-13T03:48:14.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:14.122+0000 7f625b5406c0 1 -- 10.20.193.70:0/2261230430 wait complete. 2026-02-13T03:48:14.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:14 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2261230430' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:14.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:14 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2261230430' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:14.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:14 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2261230430' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:15.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:15 trial177 ceph-mon[27082]: pgmap v275: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:15.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:15 trial127 ceph-mon[26439]: pgmap v275: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:15.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:15 trial070 ceph-mon[24757]: pgmap v275: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:17.166 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:17.285 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:17.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2816733489 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 msgr2=0x7fe31810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:17.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2816733489 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 0x7fe31810f5d0 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=6185013222511043347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe30c0099a0 tx=0x7fe30c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:17.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2816733489 shutdown_connections 2026-02-13T03:48:17.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2816733489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe318115410 0x7fe318175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:17.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2816733489 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe31810fbf0 0x7fe318114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:17.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2816733489 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 0x7fe31810f5d0 unknown :-1 s=CLOSED pgs=411 gs=1 cs=0 l=1 c_cookie=6185013222511043347 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:17.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2816733489 >> 10.20.193.70:0/2816733489 conn(0x7fe3180ecb00 msgr2=0x7fe31810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:17.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2816733489 shutdown_connections 2026-02-13T03:48:17.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2816733489 wait complete. 2026-02-13T03:48:17.409 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:17 trial070 ceph-mon[24757]: pgmap v276: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:17.411 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 Processor -- start 2026-02-13T03:48:17.411 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 -- start start 2026-02-13T03:48:17.411 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 0x7fe31811d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:17.411 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe318115410 0x7fe31811d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe318122c50 0x7fe3181230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe318123660 con 0x7fe31810f200 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181237d0 con 0x7fe318122c50 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe31d2646c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe318123990 con 0x7fe318115410 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe316d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 0x7fe31811d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe316d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 0x7fe31811d350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:35080/0 (socket says 10.20.193.70:35080) 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.405+0000 7fe316d766c0 1 -- 10.20.193.70:0/2061054196 learned_addr learned my addr 10.20.193.70:0/2061054196 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe3175776c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe318122c50 0x7fe3181230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe316d766c0 1 -- 10.20.193.70:0/2061054196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe318115410 msgr2=0x7fe31811d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe316d766c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe318115410 0x7fe31811d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe316d766c0 1 -- 10.20.193.70:0/2061054196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe318122c50 msgr2=0x7fe3181230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:17.412 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe316d766c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe318122c50 0x7fe3181230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe316d766c0 1 -- 10.20.193.70:0/2061054196 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c009590 con 0x7fe31810f200 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe316d766c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 0x7fe31811d350 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe30c02f230 tx=0x7fe30c02fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe2f7fff6c0 1 -- 10.20.193.70:0/2061054196 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe30c002ba0 con 0x7fe31810f200 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe318163de0 con 0x7fe31810f200 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe2f7fff6c0 1 -- 10.20.193.70:0/2061054196 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe30c002d00 con 0x7fe31810f200 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe2f7fff6c0 1 -- 10.20.193.70:0/2061054196 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe30c0372f0 con 0x7fe31810f200 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe318164210 con 0x7fe31810f200 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.406+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3181104d0 con 0x7fe31810f200 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.408+0000 7fe2f7fff6c0 1 -- 10.20.193.70:0/2061054196 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe30c0078d0 con 0x7fe31810f200 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.408+0000 7fe2f7fff6c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe2ec0b5600 0x7fe2ec0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.408+0000 7fe3165756c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe2ec0b5600 0x7fe2ec0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:17.413 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.408+0000 7fe2f7fff6c0 1 -- 10.20.193.70:0/2061054196 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fe30c107c20 con 0x7fe31810f200 2026-02-13T03:48:17.414 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.409+0000 7fe3165756c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe2ec0b5600 0x7fe2ec0d5ab0 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe300005980 tx=0x7fe300005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:17.414 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.409+0000 7fe2f7fff6c0 1 -- 10.20.193.70:0/2061054196 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe30c0ca6a0 con 0x7fe31810f200 2026-02-13T03:48:17.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:17 trial177 ceph-mon[27082]: pgmap v276: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:17.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:17 trial127 ceph-mon[26439]: pgmap v276: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:17.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.527+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe31810fbf0 con 0x7fe31810f200 2026-02-13T03:48:17.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.527+0000 7fe2f7fff6c0 1 -- 10.20.193.70:0/2061054196 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe30c0cd850 con 0x7fe31810f200 2026-02-13T03:48:17.529 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:17.529 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:17.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe2ec0b5600 msgr2=0x7fe2ec0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe2ec0b5600 0x7fe2ec0d5ab0 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe300005980 tx=0x7fe300005910 comp rx=0 tx=0).stop 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 msgr2=0x7fe31811d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 0x7fe31811d350 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe30c02f230 tx=0x7fe30c02fd40 comp rx=0 tx=0).stop 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 shutdown_connections 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe2ec0b5600 0x7fe2ec0d5ab0 unknown :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe318122c50 0x7fe3181230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe318115410 0x7fe31811d890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 --2- 10.20.193.70:0/2061054196 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe31810f200 0x7fe31811d350 unknown :-1 s=CLOSED pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 >> 10.20.193.70:0/2061054196 conn(0x7fe3180ecb00 msgr2=0x7fe31810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:17.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 shutdown_connections 2026-02-13T03:48:17.532 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:17.528+0000 7fe31d2646c0 1 -- 10.20.193.70:0/2061054196 wait complete. 2026-02-13T03:48:18.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:18 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2061054196' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:18.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:18 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2061054196' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:18.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:18 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2061054196' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:19.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:19 trial177 ceph-mon[27082]: pgmap v277: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:19.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:19 trial127 ceph-mon[26439]: pgmap v277: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:19.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:19 trial070 ceph-mon[24757]: pgmap v277: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:20.571 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:20.691 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:20.808 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 -- 10.20.193.70:0/890138507 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff86010cfb0 msgr2=0x7ff86010d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:20.808 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 --2- 10.20.193.70:0/890138507 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff86010cfb0 0x7ff86010d380 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=16852497191532080408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84c0099a0 tx=0x7ff84c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:20.808 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 -- 10.20.193.70:0/890138507 shutdown_connections 2026-02-13T03:48:20.808 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 --2- 10.20.193.70:0/890138507 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8601131c0 0x7ff860173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 --2- 10.20.193.70:0/890138507 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff86010d9a0 0x7ff8601129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 --2- 10.20.193.70:0/890138507 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff86010cfb0 0x7ff86010d380 unknown :-1 s=CLOSED pgs=413 gs=1 cs=0 l=1 c_cookie=16852497191532080408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 -- 10.20.193.70:0/890138507 >> 10.20.193.70:0/890138507 conn(0x7ff8600ea8b0 msgr2=0x7ff86010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 -- 10.20.193.70:0/890138507 shutdown_connections 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 -- 10.20.193.70:0/890138507 wait complete. 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 Processor -- start 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 -- start start 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff86010cfb0 0x7ff86011b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8601131c0 0x7ff86011b640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff860120a00 0x7ff860120ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:20.809 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff860121410 con 0x7ff860120a00 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff860121580 con 0x7ff86010cfb0 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff865f086c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff860121740 con 0x7ff8601131c0 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.804+0000 7ff85ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff860120a00 0x7ff860120ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff860120a00 0x7ff860120ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:35100/0 (socket says 10.20.193.70:35100) 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85ffff6c0 1 -- 10.20.193.70:0/98485768 learned_addr learned my addr 10.20.193.70:0/98485768 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85f7fe6c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff86010cfb0 0x7ff86011b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85effd6c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8601131c0 0x7ff86011b640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85ffff6c0 1 -- 10.20.193.70:0/98485768 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8601131c0 msgr2=0x7ff86011b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85ffff6c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8601131c0 0x7ff86011b640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85ffff6c0 1 -- 10.20.193.70:0/98485768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff86010cfb0 msgr2=0x7ff86011b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85ffff6c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff86010cfb0 0x7ff86011b100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.810 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85ffff6c0 1 -- 10.20.193.70:0/98485768 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c009590 con 0x7ff860120a00 2026-02-13T03:48:20.811 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85f7fe6c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff86010cfb0 0x7ff86011b100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:48:20.811 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85ffff6c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff860120a00 0x7ff860120ea0 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff854006ea0 tx=0x7ff85400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:20.811 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85cff96c0 1 -- 10.20.193.70:0/98485768 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff854003a30 con 0x7ff860120a00 2026-02-13T03:48:20.811 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85cff96c0 1 -- 10.20.193.70:0/98485768 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff8540054f0 con 0x7ff860120a00 2026-02-13T03:48:20.811 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff860161bf0 con 0x7ff860120a00 2026-02-13T03:48:20.811 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff85cff96c0 1 -- 10.20.193.70:0/98485768 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff85400dcd0 con 0x7ff860120a00 2026-02-13T03:48:20.811 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff860162080 con 0x7ff860120a00 2026-02-13T03:48:20.811 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.805+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff86010e280 con 0x7ff860120a00 2026-02-13T03:48:20.812 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.806+0000 7ff85cff96c0 1 -- 10.20.193.70:0/98485768 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff854005030 con 0x7ff860120a00 2026-02-13T03:48:20.812 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.807+0000 7ff85cff96c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8340b5600 0x7ff8340d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:20.812 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.807+0000 7ff85cff96c0 1 -- 10.20.193.70:0/98485768 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7ff8540e4c00 con 0x7ff860120a00 2026-02-13T03:48:20.812 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.807+0000 7ff85f7fe6c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8340b5600 0x7ff8340d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:20.813 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.807+0000 7ff85f7fe6c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8340b5600 0x7ff8340d5ab0 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84c005b40 tx=0x7ff84c005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:20.813 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.808+0000 7ff85cff96c0 1 -- 10.20.193.70:0/98485768 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff8540a7680 con 0x7ff860120a00 2026-02-13T03:48:20.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.926+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff86011c2b0 con 0x7ff860120a00 2026-02-13T03:48:20.929 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:20.929 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:20.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.926+0000 7ff85cff96c0 1 -- 10.20.193.70:0/98485768 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff8540aa830 con 0x7ff860120a00 2026-02-13T03:48:20.930 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8340b5600 msgr2=0x7ff8340d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:20.930 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8340b5600 0x7ff8340d5ab0 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84c005b40 tx=0x7ff84c005c00 comp rx=0 tx=0).stop 2026-02-13T03:48:20.930 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff860120a00 msgr2=0x7ff860120ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:20.930 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff860120a00 0x7ff860120ea0 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff854006ea0 tx=0x7ff85400cca0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.930 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 shutdown_connections 2026-02-13T03:48:20.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff8340b5600 0x7ff8340d5ab0 unknown :-1 s=CLOSED pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff860120a00 0x7ff860120ea0 unknown :-1 s=CLOSED pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8601131c0 0x7ff86011b640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 --2- 10.20.193.70:0/98485768 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff86010cfb0 0x7ff86011b100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:20.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 >> 10.20.193.70:0/98485768 conn(0x7ff8600ea8b0 msgr2=0x7ff86010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:20.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 shutdown_connections 2026-02-13T03:48:20.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:20.928+0000 7ff865f086c0 1 -- 10.20.193.70:0/98485768 wait complete. 2026-02-13T03:48:21.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:21 trial070 ceph-mon[24757]: pgmap v278: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:21.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:21 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/98485768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:21.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:21 trial177 ceph-mon[27082]: pgmap v278: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:21.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:21 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/98485768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:21.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:21 trial127 ceph-mon[26439]: pgmap v278: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:21.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:21 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/98485768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:23.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:23 trial177 ceph-mon[27082]: pgmap v279: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:23.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:23 trial127 ceph-mon[26439]: pgmap v279: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:23.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:23 trial070 ceph-mon[24757]: pgmap v279: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:23.974 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:24.093 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:24.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.203+0000 7f797fcb06c0 1 -- 10.20.193.70:0/963982813 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f797810f230 msgr2=0x7f797810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:24.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.203+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/963982813 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f797810f230 0x7f797810f600 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=2275486268154572728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79680099a0 tx=0x7f796802ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:24.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.203+0000 7f797fcb06c0 1 -- 10.20.193.70:0/963982813 shutdown_connections 2026-02-13T03:48:24.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.203+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/963982813 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7978115440 0x7f7978175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:24.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.203+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/963982813 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f797810fc20 0x7f7978114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:24.208 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.203+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/963982813 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f797810f230 0x7f797810f600 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=2275486268154572728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.203+0000 7f797fcb06c0 1 -- 10.20.193.70:0/963982813 >> 10.20.193.70:0/963982813 conn(0x7f79780ecb30 msgr2=0x7f797810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.203+0000 7f797fcb06c0 1 -- 10.20.193.70:0/963982813 shutdown_connections 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.203+0000 7f797fcb06c0 1 -- 10.20.193.70:0/963982813 wait complete. 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 Processor -- start 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 -- start start 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f797810f230 0x7f797811d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7978115440 0x7f797811d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7978122c20 0x7f79781230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7978123630 con 0x7f7978115440 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f79781237a0 con 0x7f797810f230 2026-02-13T03:48:24.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7978123960 con 0x7f7978122c20 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797d2246c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7978115440 0x7f797811d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797d2246c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7978115440 0x7f797811d860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:35114/0 (socket says 10.20.193.70:35114) 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797d2246c0 1 -- 10.20.193.70:0/1281016988 learned_addr learned my addr 10.20.193.70:0/1281016988 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797da256c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f797810f230 0x7f797811d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797e2266c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7978122c20 0x7f79781230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797d2246c0 1 -- 10.20.193.70:0/1281016988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7978122c20 msgr2=0x7f79781230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797d2246c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7978122c20 0x7f79781230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797d2246c0 1 -- 10.20.193.70:0/1281016988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f797810f230 msgr2=0x7f797811d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797d2246c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f797810f230 0x7f797811d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797d2246c0 1 -- 10.20.193.70:0/1281016988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7968009590 con 0x7f7978115440 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797da256c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f797810f230 0x7f797811d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:48:24.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797d2246c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7978115440 0x7f797811d860 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f796c00b6c0 tx=0x7f796c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:24.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f7966ffd6c0 1 -- 10.20.193.70:0/1281016988 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f796c004250 con 0x7f7978115440 2026-02-13T03:48:24.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f7966ffd6c0 1 -- 10.20.193.70:0/1281016988 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f796c009070 con 0x7f7978115440 2026-02-13T03:48:24.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7978163e10 con 0x7f7978115440 2026-02-13T03:48:24.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f7966ffd6c0 1 -- 10.20.193.70:0/1281016988 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f796c00ccb0 con 0x7f7978115440 2026-02-13T03:48:24.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.204+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79781642a0 con 0x7f7978115440 2026-02-13T03:48:24.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.205+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7978110500 con 0x7f7978115440 2026-02-13T03:48:24.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.206+0000 7f7966ffd6c0 1 -- 10.20.193.70:0/1281016988 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f796c0028c0 con 0x7f7978115440 2026-02-13T03:48:24.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.207+0000 7f7966ffd6c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79540b5680 0x7f79540d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:24.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.207+0000 7f7966ffd6c0 1 -- 10.20.193.70:0/1281016988 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f796c0e3a70 con 0x7f7978115440 2026-02-13T03:48:24.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.207+0000 7f797da256c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79540b5680 0x7f79540d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:24.212 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.207+0000 7f797da256c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79540b5680 0x7f79540d5b30 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7968005b40 tx=0x7f7968005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:24.213 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.208+0000 7f7966ffd6c0 1 -- 10.20.193.70:0/1281016988 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f796c0a6530 con 0x7f7978115440 2026-02-13T03:48:24.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.324+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f797810f600 con 0x7f7978115440 2026-02-13T03:48:24.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.324+0000 7f7966ffd6c0 1 -- 10.20.193.70:0/1281016988 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f796c0a96e0 con 0x7f7978115440 2026-02-13T03:48:24.327 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:24.327 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:24.328 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79540b5680 msgr2=0x7f79540d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:24.328 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79540b5680 0x7f79540d5b30 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7968005b40 tx=0x7f7968005c00 comp rx=0 tx=0).stop 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7978115440 msgr2=0x7f797811d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7978115440 0x7f797811d860 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f796c00b6c0 tx=0x7f796c00bb90 comp rx=0 tx=0).stop 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 shutdown_connections 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79540b5680 0x7f79540d5b30 unknown :-1 s=CLOSED pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7978122c20 0x7f79781230c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7978115440 0x7f797811d860 unknown :-1 s=CLOSED pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 --2- 10.20.193.70:0/1281016988 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f797810f230 0x7f797811d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 >> 10.20.193.70:0/1281016988 conn(0x7f79780ecb30 msgr2=0x7f797810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 shutdown_connections 2026-02-13T03:48:24.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:24.325+0000 7f797fcb06c0 1 -- 10.20.193.70:0/1281016988 wait complete. 2026-02-13T03:48:25.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:25 trial177 ceph-mon[27082]: pgmap v280: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:25.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:25 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1281016988' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:25.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:25 trial127 ceph-mon[26439]: pgmap v280: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:25.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:25 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1281016988' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:25.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:25 trial070 ceph-mon[24757]: pgmap v280: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:25.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:25 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1281016988' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:26.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:48:26.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:48:26.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:48:26.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:48:26.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:48:26.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:48:26.376 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:26 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:48:26.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:48:26.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:48:26.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:48:26.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:48:26.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:48:26.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:48:26.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:26 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:48:26.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:48:26.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:48:26.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:48:26.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:48:26.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:48:26.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:48:26.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:26 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:48:27.368 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:27.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:27 trial177 ceph-mon[27082]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:27.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:27 trial177 ceph-mon[27082]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 981 B/s rd, 1 op/s 2026-02-13T03:48:27.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:27 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:48:27.452 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:27 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:48:27.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:27 trial127 ceph-mon[26439]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:27.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:27 trial127 ceph-mon[26439]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 981 B/s rd, 1 op/s 2026-02-13T03:48:27.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:27 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:48:27.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:27 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:48:27.485 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:27.510 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:27 trial070 ceph-mon[24757]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:27.510 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:27 trial070 ceph-mon[24757]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 981 B/s rd, 1 op/s 2026-02-13T03:48:27.510 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:27 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:48:27.510 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:27 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:48:27.606 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.602+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2359508215 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4115440 msgr2=0x7f49d4175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:27.607 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.602+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2359508215 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4115440 0x7f49d4175de0 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=2279526556179594941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49c400aa70 tx=0x7f49c402fde0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.607 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.602+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2359508215 shutdown_connections 2026-02-13T03:48:27.607 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.602+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2359508215 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4115440 0x7f49d4175de0 unknown :-1 s=CLOSED pgs=417 gs=1 cs=0 l=1 c_cookie=2279526556179594941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.607 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.602+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2359508215 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49d410fc20 0x7f49d4114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.607 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.602+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2359508215 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49d410f230 0x7f49d410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.607 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.602+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2359508215 >> 10.20.193.70:0/2359508215 conn(0x7f49d40ecb30 msgr2=0x7f49d410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:27.607 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.602+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2359508215 shutdown_connections 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.602+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2359508215 wait complete. 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 Processor -- start 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 -- start start 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49d410f230 0x7f49d411d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49d4115440 0x7f49d411d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4122b10 0x7f49d4122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4123520 con 0x7f49d4122b10 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4123690 con 0x7f49d410f230 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4123850 con 0x7f49d4115440 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d2d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4122b10 0x7f49d4122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:27.608 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d2d766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4122b10 0x7f49d4122fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:41284/0 (socket says 10.20.193.70:41284) 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d2d766c0 1 -- 10.20.193.70:0/2362854580 learned_addr learned my addr 10.20.193.70:0/2362854580 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d1d746c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49d4115440 0x7f49d411d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d25756c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49d410f230 0x7f49d411d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d2d766c0 1 -- 10.20.193.70:0/2362854580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49d4115440 msgr2=0x7f49d411d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d2d766c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49d4115440 0x7f49d411d750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d2d766c0 1 -- 10.20.193.70:0/2362854580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49d410f230 msgr2=0x7f49d411d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d2d766c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49d410f230 0x7f49d411d210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d2d766c0 1 -- 10.20.193.70:0/2362854580 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c400a660 con 0x7f49d4122b10 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d2d766c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4122b10 0x7f49d4122fb0 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49c40054b0 tx=0x7f49c40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49bb7fe6c0 1 -- 10.20.193.70:0/2362854580 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49c4003a30 con 0x7f49d4122b10 2026-02-13T03:48:27.609 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d4163ca0 con 0x7f49d4122b10 2026-02-13T03:48:27.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49bb7fe6c0 1 -- 10.20.193.70:0/2362854580 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f49c4003b90 con 0x7f49d4122b10 2026-02-13T03:48:27.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49bb7fe6c0 1 -- 10.20.193.70:0/2362854580 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49c40382f0 con 0x7f49d4122b10 2026-02-13T03:48:27.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.603+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d41640d0 con 0x7f49d4122b10 2026-02-13T03:48:27.610 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.604+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d4110500 con 0x7f49d4122b10 2026-02-13T03:48:27.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.605+0000 7f49bb7fe6c0 1 -- 10.20.193.70:0/2362854580 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f49c4008260 con 0x7f49d4122b10 2026-02-13T03:48:27.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.606+0000 7f49bb7fe6c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49ac0b5680 0x7f49ac0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:27.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.606+0000 7f49d25756c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49ac0b5680 0x7f49ac0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:27.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.606+0000 7f49bb7fe6c0 1 -- 10.20.193.70:0/2362854580 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f49c4108e60 con 0x7f49d4122b10 2026-02-13T03:48:27.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.606+0000 7f49d25756c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49ac0b5680 0x7f49ac0d5b30 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49c8005980 tx=0x7f49c8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:27.611 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.606+0000 7f49bb7fe6c0 1 -- 10.20.193.70:0/2362854580 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f49c40cb8e0 con 0x7f49d4122b10 2026-02-13T03:48:27.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.722+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f49d410f600 con 0x7f49d4122b10 2026-02-13T03:48:27.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.722+0000 7f49bb7fe6c0 1 -- 10.20.193.70:0/2362854580 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f49c40cea90 con 0x7f49d4122b10 2026-02-13T03:48:27.725 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:27.725 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:27.726 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49ac0b5680 msgr2=0x7f49ac0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:27.726 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49ac0b5680 0x7f49ac0d5b30 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49c8005980 tx=0x7f49c8005910 comp rx=0 tx=0).stop 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4122b10 msgr2=0x7f49d4122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4122b10 0x7f49d4122fb0 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49c40054b0 tx=0x7f49c40054e0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 shutdown_connections 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f49ac0b5680 0x7f49ac0d5b30 unknown :-1 s=CLOSED pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f49d4122b10 0x7f49d4122fb0 unknown :-1 s=CLOSED pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49d4115440 0x7f49d411d750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 --2- 10.20.193.70:0/2362854580 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f49d410f230 0x7f49d411d210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.723+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 >> 10.20.193.70:0/2362854580 conn(0x7f49d40ecb30 msgr2=0x7f49d410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.724+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 shutdown_connections 2026-02-13T03:48:27.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:27.724+0000 7f49d8c256c0 1 -- 10.20.193.70:0/2362854580 wait complete. 2026-02-13T03:48:28.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:28 trial177 ceph-mon[27082]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:28.463 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:28 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:48:28.463 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:28 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2362854580' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:28.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:28 trial127 ceph-mon[26439]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:28.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:28 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:48:28.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:28 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2362854580' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:28.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:28 trial070 ceph-mon[24757]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:28.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:28 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:48:28.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:28 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2362854580' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:30.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:30 trial177 ceph-mon[27082]: pgmap v284: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 567 B/s rd, 1 op/s 2026-02-13T03:48:30.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:30 trial127 ceph-mon[26439]: pgmap v284: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 567 B/s rd, 1 op/s 2026-02-13T03:48:30.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:30 trial070 ceph-mon[24757]: pgmap v284: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 567 B/s rd, 1 op/s 2026-02-13T03:48:30.768 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:30.886 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:31.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 -- 10.20.193.70:0/4224399071 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 msgr2=0x7fc620173720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:31.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 --2- 10.20.193.70:0/4224399071 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 0x7fc620173720 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=17729505787594556658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc61400aa40 tx=0x7fc61402fde0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 -- 10.20.193.70:0/4224399071 shutdown_connections 2026-02-13T03:48:31.005 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 --2- 10.20.193.70:0/4224399071 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 0x7fc620173720 unknown :-1 s=CLOSED pgs=419 gs=1 cs=0 l=1 c_cookie=17729505787594556658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 --2- 10.20.193.70:0/4224399071 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc62010e740 0x7fc620152dc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 --2- 10.20.193.70:0/4224399071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc62010dd50 0x7fc62010e120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 -- 10.20.193.70:0/4224399071 >> 10.20.193.70:0/4224399071 conn(0x7fc6200e9740 msgr2=0x7fc620109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 -- 10.20.193.70:0/4224399071 shutdown_connections 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 -- 10.20.193.70:0/4224399071 wait complete. 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 Processor -- start 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 -- start start 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc62010dd50 0x7fc62010bbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc62010e740 0x7fc62010c120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 0x7fc62010c660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:31.006 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc62014ee10 con 0x7fc620153300 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc62014ef80 con 0x7fc62010dd50 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc625e186c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc62014f140 con 0x7fc62010e740 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc61ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 0x7fc62010c660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc61ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 0x7fc62010c660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:41294/0 (socket says 10.20.193.70:41294) 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.001+0000 7fc61ffff6c0 1 -- 10.20.193.70:0/1791252181 learned_addr learned my addr 10.20.193.70:0/1791252181 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61effd6c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc62010e740 0x7fc62010c120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61f7fe6c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc62010dd50 0x7fc62010bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61ffff6c0 1 -- 10.20.193.70:0/1791252181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc62010e740 msgr2=0x7fc62010c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61ffff6c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc62010e740 0x7fc62010c120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61ffff6c0 1 -- 10.20.193.70:0/1791252181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc62010dd50 msgr2=0x7fc62010bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:31.007 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61ffff6c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc62010dd50 0x7fc62010bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61ffff6c0 1 -- 10.20.193.70:0/1791252181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61400a660 con 0x7fc620153300 2026-02-13T03:48:31.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61f7fe6c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc62010dd50 0x7fc62010bbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:31.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61ffff6c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 0x7fc62010c660 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc61400a390 tx=0x7fc614005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:31.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61cff96c0 1 -- 10.20.193.70:0/1791252181 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc614003a30 con 0x7fc620153300 2026-02-13T03:48:31.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61cff96c0 1 -- 10.20.193.70:0/1791252181 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc614003b90 con 0x7fc620153300 2026-02-13T03:48:31.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62014f3c0 con 0x7fc620153300 2026-02-13T03:48:31.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc61cff96c0 1 -- 10.20.193.70:0/1791252181 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc6140382f0 con 0x7fc620153300 2026-02-13T03:48:31.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62014f7f0 con 0x7fc620153300 2026-02-13T03:48:31.008 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.002+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc62005faf0 con 0x7fc620153300 2026-02-13T03:48:31.009 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.003+0000 7fc61cff96c0 1 -- 10.20.193.70:0/1791252181 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fc614008260 con 0x7fc620153300 2026-02-13T03:48:31.009 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.004+0000 7fc61cff96c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc5f40b5600 0x7fc5f40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:31.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.004+0000 7fc61f7fe6c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc5f40b5600 0x7fc5f40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:31.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.004+0000 7fc61cff96c0 1 -- 10.20.193.70:0/1791252181 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fc614109000 con 0x7fc620153300 2026-02-13T03:48:31.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.005+0000 7fc61f7fe6c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc5f40b5600 0x7fc5f40d5ab0 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc60c004750 tx=0x7fc60c005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:31.010 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.005+0000 7fc61cff96c0 1 -- 10.20.193.70:0/1791252181 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc6140cf520 con 0x7fc620153300 2026-02-13T03:48:31.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.123+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc62010e120 con 0x7fc620153300 2026-02-13T03:48:31.125 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.123+0000 7fc61cff96c0 1 -- 10.20.193.70:0/1791252181 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc6140cec70 con 0x7fc620153300 2026-02-13T03:48:31.125 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:31.125 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:31.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc5f40b5600 msgr2=0x7fc5f40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc5f40b5600 0x7fc5f40d5ab0 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc60c004750 tx=0x7fc60c005f10 comp rx=0 tx=0).stop 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 msgr2=0x7fc62010c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 0x7fc62010c660 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc61400a390 tx=0x7fc614005530 comp rx=0 tx=0).stop 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 shutdown_connections 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc5f40b5600 0x7fc5f40d5ab0 unknown :-1 s=CLOSED pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc620153300 0x7fc62010c660 unknown :-1 s=CLOSED pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc62010e740 0x7fc62010c120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 --2- 10.20.193.70:0/1791252181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc62010dd50 0x7fc62010bbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 >> 10.20.193.70:0/1791252181 conn(0x7fc6200e9740 msgr2=0x7fc620109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:31.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 shutdown_connections 2026-02-13T03:48:31.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:31.124+0000 7fc625e186c0 1 -- 10.20.193.70:0/1791252181 wait complete. 2026-02-13T03:48:31.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:31 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1791252181' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:31.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:31 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1791252181' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:31.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:31 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1791252181' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:32.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:32 trial177 ceph-mon[27082]: pgmap v285: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:32.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:32 trial127 ceph-mon[26439]: pgmap v285: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:32.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:32 trial070 ceph-mon[24757]: pgmap v285: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:34.166 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:34.283 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:34.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.402+0000 7fb5818186c0 1 -- 10.20.193.70:0/3435345619 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c115410 msgr2=0x7fb57c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:34.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.402+0000 7fb5818186c0 1 --2- 10.20.193.70:0/3435345619 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c115410 0x7fb57c175db0 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=5867685896041165176 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb56c00aa70 tx=0x7fb56c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.406 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.402+0000 7fb5818186c0 1 -- 10.20.193.70:0/3435345619 shutdown_connections 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.402+0000 7fb5818186c0 1 --2- 10.20.193.70:0/3435345619 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c115410 0x7fb57c175db0 unknown :-1 s=CLOSED pgs=421 gs=1 cs=0 l=1 c_cookie=5867685896041165176 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.402+0000 7fb5818186c0 1 --2- 10.20.193.70:0/3435345619 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb57c10fbf0 0x7fb57c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.402+0000 7fb5818186c0 1 --2- 10.20.193.70:0/3435345619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb57c10f200 0x7fb57c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.402+0000 7fb5818186c0 1 -- 10.20.193.70:0/3435345619 >> 10.20.193.70:0/3435345619 conn(0x7fb57c0ecb00 msgr2=0x7fb57c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.402+0000 7fb5818186c0 1 -- 10.20.193.70:0/3435345619 shutdown_connections 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.402+0000 7fb5818186c0 1 -- 10.20.193.70:0/3435345619 wait complete. 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 Processor -- start 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 -- start start 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c10f200 0x7fb57c11d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb57c115410 0x7fb57c11d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb57c122b90 0x7fb57c123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:34.407 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c1235a0 con 0x7fb57c10f200 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c123710 con 0x7fb57c122b90 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c1238d0 con 0x7fb57c115410 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57affd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c10f200 0x7fb57c11d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57affd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c10f200 0x7fb57c11d290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:41308/0 (socket says 10.20.193.70:41308) 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57affd6c0 1 -- 10.20.193.70:0/2590092289 learned_addr learned my addr 10.20.193.70:0/2590092289 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57a7fc6c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb57c115410 0x7fb57c11d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57b7fe6c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb57c122b90 0x7fb57c123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57affd6c0 1 -- 10.20.193.70:0/2590092289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb57c115410 msgr2=0x7fb57c11d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57affd6c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb57c115410 0x7fb57c11d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57affd6c0 1 -- 10.20.193.70:0/2590092289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb57c122b90 msgr2=0x7fb57c123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57affd6c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb57c122b90 0x7fb57c123030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.408 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57affd6c0 1 -- 10.20.193.70:0/2590092289 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c00a660 con 0x7fb57c10f200 2026-02-13T03:48:34.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57a7fc6c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb57c115410 0x7fb57c11d7d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:48:34.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb57affd6c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c10f200 0x7fb57c11d290 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb570009490 tx=0x7fb57000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:34.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5808126c0 1 -- 10.20.193.70:0/2590092289 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb570004a80 con 0x7fb57c10f200 2026-02-13T03:48:34.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5808126c0 1 -- 10.20.193.70:0/2590092289 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb570009030 con 0x7fb57c10f200 2026-02-13T03:48:34.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57c163d80 con 0x7fb57c10f200 2026-02-13T03:48:34.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5808126c0 1 -- 10.20.193.70:0/2590092289 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb57000cdd0 con 0x7fb57c10f200 2026-02-13T03:48:34.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.403+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb57c164210 con 0x7fb57c10f200 2026-02-13T03:48:34.409 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.404+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb57c1104d0 con 0x7fb57c10f200 2026-02-13T03:48:34.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.405+0000 7fb5808126c0 1 -- 10.20.193.70:0/2590092289 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fb570005000 con 0x7fb57c10f200 2026-02-13T03:48:34.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.406+0000 7fb5808126c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb5500b5600 0x7fb5500d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:34.410 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.406+0000 7fb57a7fc6c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb5500b5600 0x7fb5500d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:34.411 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.406+0000 7fb5808126c0 1 -- 10.20.193.70:0/2590092289 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fb5700e3bb0 con 0x7fb57c10f200 2026-02-13T03:48:34.411 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.406+0000 7fb57a7fc6c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb5500b5600 0x7fb5500d5ab0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb564005e40 tx=0x7fb564005dd0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:34.411 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.406+0000 7fb5808126c0 1 -- 10.20.193.70:0/2590092289 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb5700a6670 con 0x7fb57c10f200 2026-02-13T03:48:34.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:34 trial177 ceph-mon[27082]: pgmap v286: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:34.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:34 trial127 ceph-mon[26439]: pgmap v286: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:34.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.528+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb57c10f5d0 con 0x7fb57c10f200 2026-02-13T03:48:34.530 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:34 trial070 ceph-mon[24757]: pgmap v286: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:34.531 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:34.531 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:34.532 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.528+0000 7fb5808126c0 1 -- 10.20.193.70:0/2590092289 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb5700a9820 con 0x7fb57c10f200 2026-02-13T03:48:34.532 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb5500b5600 msgr2=0x7fb5500d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:34.532 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb5500b5600 0x7fb5500d5ab0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb564005e40 tx=0x7fb564005dd0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.532 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c10f200 msgr2=0x7fb57c11d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:34.532 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c10f200 0x7fb57c11d290 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb570009490 tx=0x7fb57000bc50 comp rx=0 tx=0).stop 2026-02-13T03:48:34.532 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 shutdown_connections 2026-02-13T03:48:34.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb5500b5600 0x7fb5500d5ab0 unknown :-1 s=CLOSED pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb57c122b90 0x7fb57c123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb57c115410 0x7fb57c11d7d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 --2- 10.20.193.70:0/2590092289 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb57c10f200 0x7fb57c11d290 unknown :-1 s=CLOSED pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:34.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 >> 10.20.193.70:0/2590092289 conn(0x7fb57c0ecb00 msgr2=0x7fb57c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:34.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 shutdown_connections 2026-02-13T03:48:34.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:34.529+0000 7fb5818186c0 1 -- 10.20.193.70:0/2590092289 wait complete. 2026-02-13T03:48:35.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:35 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2590092289' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:35.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:35 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2590092289' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:35.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:35 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2590092289' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:36.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:36 trial177 ceph-mon[27082]: pgmap v287: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:36.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:36 trial127 ceph-mon[26439]: pgmap v287: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:36.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:36 trial070 ceph-mon[24757]: pgmap v287: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:48:37.576 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:37.697 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:37.818 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.814+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/426910437 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 msgr2=0x7f50d410d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:37.818 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.814+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/426910437 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 0x7f50d410d380 secure :-1 s=READY pgs=423 gs=1 cs=0 l=1 c_cookie=10483705703528071286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50c80099a0 tx=0x7f50c802ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:37.819 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.814+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/426910437 shutdown_connections 2026-02-13T03:48:37.819 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.814+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/426910437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f50d41131c0 0x7f50d4173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:37.819 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.814+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/426910437 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50d410d9a0 0x7f50d41129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:37.819 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.814+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/426910437 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 0x7f50d410d380 unknown :-1 s=CLOSED pgs=423 gs=1 cs=0 l=1 c_cookie=10483705703528071286 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:37.819 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.814+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/426910437 >> 10.20.193.70:0/426910437 conn(0x7f50d40ea8b0 msgr2=0x7f50d410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:37.819 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.814+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/426910437 shutdown_connections 2026-02-13T03:48:37.819 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.814+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/426910437 wait complete. 2026-02-13T03:48:37.819 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 Processor -- start 2026-02-13T03:48:37.819 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 -- start start 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 0x7f50d411b090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50d41131c0 0x7f50d411b5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f50d4120990 0x7f50d4120e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f50d41213a0 con 0x7f50d410cfb0 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4121510 con 0x7f50d41131c0 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f50d41216d0 con 0x7f50d4120990 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d25756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 0x7f50d411b090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d25756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 0x7f50d411b090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:47692/0 (socket says 10.20.193.70:47692) 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d25756c0 1 -- 10.20.193.70:0/3176290945 learned_addr learned my addr 10.20.193.70:0/3176290945 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d1d746c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50d41131c0 0x7f50d411b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d2d766c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f50d4120990 0x7f50d4120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:37.820 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d25756c0 1 -- 10.20.193.70:0/3176290945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f50d4120990 msgr2=0x7f50d4120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d25756c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f50d4120990 0x7f50d4120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d25756c0 1 -- 10.20.193.70:0/3176290945 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50d41131c0 msgr2=0x7f50d411b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d25756c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50d41131c0 0x7f50d411b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d25756c0 1 -- 10.20.193.70:0/3176290945 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c8009590 con 0x7f50d410cfb0 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d25756c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 0x7f50d411b090 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50c802f230 tx=0x7f50c802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50bb7fe6c0 1 -- 10.20.193.70:0/3176290945 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50c8002ba0 con 0x7f50d410cfb0 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d4161b20 con 0x7f50d410cfb0 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50bb7fe6c0 1 -- 10.20.193.70:0/3176290945 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f50c8002d00 con 0x7f50d410cfb0 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50bb7fe6c0 1 -- 10.20.193.70:0/3176290945 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50c80372f0 con 0x7f50d410cfb0 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.815+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d4161f50 con 0x7f50d410cfb0 2026-02-13T03:48:37.821 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.816+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d410e280 con 0x7f50d410cfb0 2026-02-13T03:48:37.822 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.817+0000 7f50bb7fe6c0 1 -- 10.20.193.70:0/3176290945 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f50c80078d0 con 0x7f50d410cfb0 2026-02-13T03:48:37.823 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.818+0000 7f50bb7fe6c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f50ac0b5600 0x7f50ac0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:37.823 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.818+0000 7f50d1d746c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f50ac0b5600 0x7f50ac0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:37.823 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.818+0000 7f50bb7fe6c0 1 -- 10.20.193.70:0/3176290945 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f50c8107c20 con 0x7f50d410cfb0 2026-02-13T03:48:37.823 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.818+0000 7f50bb7fe6c0 1 -- 10.20.193.70:0/3176290945 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f50c80ca6a0 con 0x7f50d410cfb0 2026-02-13T03:48:37.823 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.818+0000 7f50d1d746c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f50ac0b5600 0x7f50ac0d5ab0 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50bc005dc0 tx=0x7f50bc005d10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:37.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.936+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f50d410d9a0 con 0x7f50d410cfb0 2026-02-13T03:48:37.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.936+0000 7f50bb7fe6c0 1 -- 10.20.193.70:0/3176290945 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f50c80cd850 con 0x7f50d410cfb0 2026-02-13T03:48:37.938 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:37.939 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:37.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f50ac0b5600 msgr2=0x7f50ac0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:37.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f50ac0b5600 0x7f50ac0d5ab0 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50bc005dc0 tx=0x7f50bc005d10 comp rx=0 tx=0).stop 2026-02-13T03:48:37.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 msgr2=0x7f50d411b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:37.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 0x7f50d411b090 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50c802f230 tx=0x7f50c802fd40 comp rx=0 tx=0).stop 2026-02-13T03:48:37.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 shutdown_connections 2026-02-13T03:48:37.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f50ac0b5600 0x7f50ac0d5ab0 unknown :-1 s=CLOSED pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:37.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f50d4120990 0x7f50d4120e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:37.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f50d41131c0 0x7f50d411b5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:37.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 --2- 10.20.193.70:0/3176290945 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f50d410cfb0 0x7f50d411b090 unknown :-1 s=CLOSED pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:37.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 >> 10.20.193.70:0/3176290945 conn(0x7f50d40ea8b0 msgr2=0x7f50d410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:37.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 shutdown_connections 2026-02-13T03:48:37.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:37.938+0000 7f50d8dbc6c0 1 -- 10.20.193.70:0/3176290945 wait complete. 2026-02-13T03:48:38.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:38 trial070 ceph-mon[24757]: pgmap v288: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 966 B/s rd, 1 op/s 2026-02-13T03:48:38.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:38 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3176290945' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:38.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:38 trial177 ceph-mon[27082]: pgmap v288: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 966 B/s rd, 1 op/s 2026-02-13T03:48:38.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:38 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3176290945' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:38.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:38 trial127 ceph-mon[26439]: pgmap v288: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 966 B/s rd, 1 op/s 2026-02-13T03:48:38.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:38 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3176290945' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:40.277 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:40 trial127 ceph-mon[26439]: pgmap v289: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:40.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:40 trial177 ceph-mon[27082]: pgmap v289: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:40.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:40 trial070 ceph-mon[24757]: pgmap v289: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:40.982 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:41.103 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:41.233 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.229+0000 7f2d33c696c0 1 -- 10.20.193.70:0/2229210628 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c1131c0 msgr2=0x7f2d2c173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:41.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.229+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/2229210628 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c1131c0 0x7f2d2c173b60 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=3166428491407089178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d2800aa70 tx=0x7f2d2802fde0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.229+0000 7f2d33c696c0 1 -- 10.20.193.70:0/2229210628 shutdown_connections 2026-02-13T03:48:41.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.229+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/2229210628 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c1131c0 0x7f2d2c173b60 unknown :-1 s=CLOSED pgs=425 gs=1 cs=0 l=1 c_cookie=3166428491407089178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.229+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/2229210628 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d2c10d9a0 0x7f2d2c1129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.229+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/2229210628 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d2c10cfb0 0x7f2d2c10d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.229+0000 7f2d33c696c0 1 -- 10.20.193.70:0/2229210628 >> 10.20.193.70:0/2229210628 conn(0x7f2d2c0ea8b0 msgr2=0x7f2d2c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:41.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.229+0000 7f2d33c696c0 1 -- 10.20.193.70:0/2229210628 shutdown_connections 2026-02-13T03:48:41.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.229+0000 7f2d33c696c0 1 -- 10.20.193.70:0/2229210628 wait complete. 2026-02-13T03:48:41.234 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 Processor -- start 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 -- start start 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d2c10cfb0 0x7f2d2c11af60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d2c1131c0 0x7f2d2c11b4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c120860 0x7f2d2c120d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c121270 con 0x7f2d2c120860 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c1213e0 con 0x7f2d2c10cfb0 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c1215a0 con 0x7f2d2c1131c0 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d321db6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c120860 0x7f2d2c120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d321db6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c120860 0x7f2d2c120d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:47706/0 (socket says 10.20.193.70:47706) 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d321db6c0 1 -- 10.20.193.70:0/3218807013 learned_addr learned my addr 10.20.193.70:0/3218807013 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:41.235 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d319da6c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d2c10cfb0 0x7f2d2c11af60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d311d96c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d2c1131c0 0x7f2d2c11b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d321db6c0 1 -- 10.20.193.70:0/3218807013 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d2c1131c0 msgr2=0x7f2d2c11b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d321db6c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d2c1131c0 0x7f2d2c11b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d321db6c0 1 -- 10.20.193.70:0/3218807013 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d2c10cfb0 msgr2=0x7f2d2c11af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d321db6c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d2c10cfb0 0x7f2d2c11af60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d321db6c0 1 -- 10.20.193.70:0/3218807013 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2800a660 con 0x7f2d2c120860 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d321db6c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c120860 0x7f2d2c120d00 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d280054b0 tx=0x7f2d280054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d1affd6c0 1 -- 10.20.193.70:0/3218807013 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d28003a30 con 0x7f2d2c120860 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d1affd6c0 1 -- 10.20.193.70:0/3218807013 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2d28003b90 con 0x7f2d2c120860 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2c1619f0 con 0x7f2d2c120860 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d1affd6c0 1 -- 10.20.193.70:0/3218807013 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d280382f0 con 0x7f2d2c120860 2026-02-13T03:48:41.236 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.230+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2c161e20 con 0x7f2d2c120860 2026-02-13T03:48:41.237 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.231+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2c10e280 con 0x7f2d2c120860 2026-02-13T03:48:41.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.232+0000 7f2d1affd6c0 1 -- 10.20.193.70:0/3218807013 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f2d28008260 con 0x7f2d2c120860 2026-02-13T03:48:41.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.233+0000 7f2d1affd6c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2d080b5600 0x7f2d080d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:41.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.233+0000 7f2d319da6c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2d080b5600 0x7f2d080d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:41.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.233+0000 7f2d1affd6c0 1 -- 10.20.193.70:0/3218807013 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f2d28108e90 con 0x7f2d2c120860 2026-02-13T03:48:41.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.233+0000 7f2d319da6c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2d080b5600 0x7f2d080d5ab0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d1c005dc0 tx=0x7f2d1c005d10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:41.238 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.233+0000 7f2d1affd6c0 1 -- 10.20.193.70:0/3218807013 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2d280ceb00 con 0x7f2d2c120860 2026-02-13T03:48:41.354 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.352+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2d2c10d380 con 0x7f2d2c120860 2026-02-13T03:48:41.354 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:41.355 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:41.355 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.352+0000 7f2d1affd6c0 1 -- 10.20.193.70:0/3218807013 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2d280cece0 con 0x7f2d2c120860 2026-02-13T03:48:41.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.354+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2d080b5600 msgr2=0x7f2d080d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:41.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.354+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2d080b5600 0x7f2d080d5ab0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d1c005dc0 tx=0x7f2d1c005d10 comp rx=0 tx=0).stop 2026-02-13T03:48:41.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.354+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c120860 msgr2=0x7f2d2c120d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:41.357 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.354+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c120860 0x7f2d2c120d00 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d280054b0 tx=0x7f2d280054e0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.355+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 shutdown_connections 2026-02-13T03:48:41.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.355+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f2d080b5600 0x7f2d080d5ab0 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.355+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f2d2c120860 0x7f2d2c120d00 unknown :-1 s=CLOSED pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.355+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d2c1131c0 0x7f2d2c11b4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.355+0000 7f2d33c696c0 1 --2- 10.20.193.70:0/3218807013 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f2d2c10cfb0 0x7f2d2c11af60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:41.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.355+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 >> 10.20.193.70:0/3218807013 conn(0x7f2d2c0ea8b0 msgr2=0x7f2d2c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:41.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.355+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 shutdown_connections 2026-02-13T03:48:41.358 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:41.355+0000 7f2d33c696c0 1 -- 10.20.193.70:0/3218807013 wait complete. 2026-02-13T03:48:42.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:42 trial177 ceph-mon[27082]: pgmap v290: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:42.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:42 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3218807013' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:42.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:42 trial127 ceph-mon[26439]: pgmap v290: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:42.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:42 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3218807013' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:42.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:42 trial070 ceph-mon[24757]: pgmap v290: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:42.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:42 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3218807013' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:44.401 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:44.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:44 trial177 ceph-mon[27082]: pgmap v291: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:44.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:44 trial127 ceph-mon[26439]: pgmap v291: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:44.516 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:44.538 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:44 trial070 ceph-mon[24757]: pgmap v291: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:44.642 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 -- 10.20.193.70:0/4111880488 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10fc20 msgr2=0x7f017c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:44.642 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4111880488 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10fc20 0x7f017c114c60 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=12494932808820345582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01640099a0 tx=0x7f016402ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:44.642 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 -- 10.20.193.70:0/4111880488 shutdown_connections 2026-02-13T03:48:44.642 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4111880488 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f017c115440 0x7f017c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4111880488 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10fc20 0x7f017c114c60 unknown :-1 s=CLOSED pgs=427 gs=1 cs=0 l=1 c_cookie=12494932808820345582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4111880488 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f017c10f230 0x7f017c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 -- 10.20.193.70:0/4111880488 >> 10.20.193.70:0/4111880488 conn(0x7f017c0ecb30 msgr2=0x7f017c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 -- 10.20.193.70:0/4111880488 shutdown_connections 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 -- 10.20.193.70:0/4111880488 wait complete. 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 Processor -- start 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 -- start start 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10f230 0x7f017c0f4cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f017c115440 0x7f017c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f017c0f52f0 0x7f017c0fa5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:44.643 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f017c0f59e0 con 0x7f017c10f230 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f017c0fab00 con 0x7f017c115440 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.638+0000 7f0180d436c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f017c0facc0 con 0x7f017c0f52f0 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017a5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10f230 0x7f017c0f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017a5756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10f230 0x7f017c0f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:47718/0 (socket says 10.20.193.70:47718) 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017a5756c0 1 -- 10.20.193.70:0/4166739275 learned_addr learned my addr 10.20.193.70:0/4166739275 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017a5756c0 1 -- 10.20.193.70:0/4166739275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f017c0f52f0 msgr2=0x7f017c0fa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017ad766c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f017c0f52f0 0x7f017c0fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f0179d746c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f017c115440 0x7f017c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017a5756c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f017c0f52f0 0x7f017c0fa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017a5756c0 1 -- 10.20.193.70:0/4166739275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f017c115440 msgr2=0x7f017c175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:44.644 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017a5756c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f017c115440 0x7f017c175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017a5756c0 1 -- 10.20.193.70:0/4166739275 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0164009590 con 0x7f017c10f230 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f0179d746c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f017c115440 0x7f017c175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017ad766c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f017c0f52f0 0x7f017c0fa5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f017a5756c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10f230 0x7f017c0f4cc0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0170005dc0 tx=0x7f017000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f01637fe6c0 1 -- 10.20.193.70:0/4166739275 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0170004250 con 0x7f017c10f230 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017c0fafa0 con 0x7f017c10f230 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f01637fe6c0 1 -- 10.20.193.70:0/4166739275 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0170009070 con 0x7f017c10f230 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f01637fe6c0 1 -- 10.20.193.70:0/4166739275 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f017000cde0 con 0x7f017c10f230 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017c0fb430 con 0x7f017c10f230 2026-02-13T03:48:44.645 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.639+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017c110500 con 0x7f017c10f230 2026-02-13T03:48:44.646 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.641+0000 7f01637fe6c0 1 -- 10.20.193.70:0/4166739275 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f01700028c0 con 0x7f017c10f230 2026-02-13T03:48:44.646 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.642+0000 7f01637fe6c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01540b5600 0x7f01540d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:44.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.642+0000 7f0179d746c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01540b5600 0x7f01540d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:44.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.642+0000 7f01637fe6c0 1 -- 10.20.193.70:0/4166739275 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f01700e38c0 con 0x7f017c10f230 2026-02-13T03:48:44.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.642+0000 7f0179d746c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01540b5600 0x7f01540d5ab0 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01640098c0 tx=0x7f0164009250 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:44.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.642+0000 7f01637fe6c0 1 -- 10.20.193.70:0/4166739275 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f01700a6340 con 0x7f017c10f230 2026-02-13T03:48:44.763 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.761+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f017c10f600 con 0x7f017c10f230 2026-02-13T03:48:44.763 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.761+0000 7f01637fe6c0 1 -- 10.20.193.70:0/4166739275 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f01700a94f0 con 0x7f017c10f230 2026-02-13T03:48:44.764 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:44.764 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:44.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01540b5600 msgr2=0x7f01540d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:44.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01540b5600 0x7f01540d5ab0 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01640098c0 tx=0x7f0164009250 comp rx=0 tx=0).stop 2026-02-13T03:48:44.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10f230 msgr2=0x7f017c0f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:44.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10f230 0x7f017c0f4cc0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0170005dc0 tx=0x7f017000bbb0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 shutdown_connections 2026-02-13T03:48:44.765 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f01540b5600 0x7f01540d5ab0 unknown :-1 s=CLOSED pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f017c0f52f0 0x7f017c0fa5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f017c115440 0x7f017c175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 --2- 10.20.193.70:0/4166739275 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f017c10f230 0x7f017c0f4cc0 unknown :-1 s=CLOSED pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:44.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 >> 10.20.193.70:0/4166739275 conn(0x7f017c0ecb30 msgr2=0x7f017c10d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:44.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 shutdown_connections 2026-02-13T03:48:44.766 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:44.763+0000 7f0180d436c0 1 -- 10.20.193.70:0/4166739275 wait complete. 2026-02-13T03:48:45.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:45 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4166739275' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:45.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:45 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4166739275' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:45.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:45 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4166739275' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:46.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:46 trial177 ceph-mon[27082]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:46.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:46 trial127 ceph-mon[26439]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:46.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:46 trial070 ceph-mon[24757]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:47.806 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:47.929 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:48.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.040+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/352354872 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 msgr2=0x7f7dcc175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:48.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.040+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/352354872 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 0x7f7dcc175de0 secure :-1 s=READY pgs=429 gs=1 cs=0 l=1 c_cookie=16325345728370931158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dbc00aa70 tx=0x7f7dbc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.040+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/352354872 shutdown_connections 2026-02-13T03:48:48.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.040+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/352354872 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 0x7f7dcc175de0 unknown :-1 s=CLOSED pgs=429 gs=1 cs=0 l=1 c_cookie=16325345728370931158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.040+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/352354872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dcc10fc20 0x7f7dcc114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.045 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.040+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/352354872 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7dcc10f230 0x7f7dcc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.040+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/352354872 >> 10.20.193.70:0/352354872 conn(0x7f7dcc0ecb30 msgr2=0x7f7dcc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.040+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/352354872 shutdown_connections 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.040+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/352354872 wait complete. 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 Processor -- start 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 -- start start 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dcc10f230 0x7f7dcc11d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 0x7f7dcc11d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7dcc122af0 0x7f7dcc122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc123500 con 0x7f7dcc115440 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc123670 con 0x7f7dcc122af0 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc123830 con 0x7f7dcc10f230 2026-02-13T03:48:48.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dca7fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 0x7f7dcc11d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dca7fc6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 0x7f7dcc11d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:60782/0 (socket says 10.20.193.70:60782) 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dca7fc6c0 1 -- 10.20.193.70:0/1731995141 learned_addr learned my addr 10.20.193.70:0/1731995141 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dcaffd6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dcc10f230 0x7f7dcc11d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dcb7fe6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7dcc122af0 0x7f7dcc122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dca7fc6c0 1 -- 10.20.193.70:0/1731995141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dcc10f230 msgr2=0x7f7dcc11d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dca7fc6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dcc10f230 0x7f7dcc11d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dca7fc6c0 1 -- 10.20.193.70:0/1731995141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7dcc122af0 msgr2=0x7f7dcc122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dca7fc6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7dcc122af0 0x7f7dcc122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dca7fc6c0 1 -- 10.20.193.70:0/1731995141 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc00a660 con 0x7f7dcc115440 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dca7fc6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 0x7f7dcc11d730 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db4005dc0 tx=0x7f7db400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dabfff6c0 1 -- 10.20.193.70:0/1731995141 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7db4004250 con 0x7f7dcc115440 2026-02-13T03:48:48.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dabfff6c0 1 -- 10.20.193.70:0/1731995141 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7db4009070 con 0x7f7dcc115440 2026-02-13T03:48:48.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc163ce0 con 0x7f7dcc115440 2026-02-13T03:48:48.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dabfff6c0 1 -- 10.20.193.70:0/1731995141 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7db400cd50 con 0x7f7dcc115440 2026-02-13T03:48:48.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.041+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1641c0 con 0x7f7dcc115440 2026-02-13T03:48:48.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.042+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc110500 con 0x7f7dcc115440 2026-02-13T03:48:48.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.043+0000 7f7dabfff6c0 1 -- 10.20.193.70:0/1731995141 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f7db40028c0 con 0x7f7dcc115440 2026-02-13T03:48:48.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.043+0000 7f7dabfff6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7da00b5680 0x7f7da00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:48.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.044+0000 7f7dabfff6c0 1 -- 10.20.193.70:0/1731995141 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f7db40e3a90 con 0x7f7dcc115440 2026-02-13T03:48:48.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.044+0000 7f7dcaffd6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7da00b5680 0x7f7da00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:48.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.044+0000 7f7dcaffd6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7da00b5680 0x7f7da00d5b30 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc0005980 tx=0x7f7dc0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:48.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.044+0000 7f7dabfff6c0 1 -- 10.20.193.70:0/1731995141 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7db40a6510 con 0x7f7dcc115440 2026-02-13T03:48:48.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.160+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7dcc10f600 con 0x7f7dcc115440 2026-02-13T03:48:48.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.161+0000 7f7dabfff6c0 1 -- 10.20.193.70:0/1731995141 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7db40a96c0 con 0x7f7dcc115440 2026-02-13T03:48:48.163 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:48.163 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:48.164 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7da00b5680 msgr2=0x7f7da00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7da00b5680 0x7f7da00d5b30 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc0005980 tx=0x7f7dc0005910 comp rx=0 tx=0).stop 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 msgr2=0x7f7dcc11d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 0x7f7dcc11d730 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7db4005dc0 tx=0x7f7db400bbb0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 shutdown_connections 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7da00b5680 0x7f7da00d5b30 unknown :-1 s=CLOSED pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7dcc122af0 0x7f7dcc122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7dcc115440 0x7f7dcc11d730 unknown :-1 s=CLOSED pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 --2- 10.20.193.70:0/1731995141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dcc10f230 0x7f7dcc11d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 >> 10.20.193.70:0/1731995141 conn(0x7f7dcc0ecb30 msgr2=0x7f7dcc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 shutdown_connections 2026-02-13T03:48:48.165 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:48.162+0000 7f7dd16fb6c0 1 -- 10.20.193.70:0/1731995141 wait complete. 2026-02-13T03:48:48.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:48 trial177 ceph-mon[27082]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:48.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:48 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1731995141' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:48.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:48 trial127 ceph-mon[26439]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:48.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:48 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1731995141' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:48.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:48 trial070 ceph-mon[24757]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:48.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:48 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1731995141' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:50.451 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:50 trial177 ceph-mon[27082]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:50.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:50 trial127 ceph-mon[26439]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:50.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:50 trial070 ceph-mon[24757]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:51.204 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:51.324 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:51.442 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.438+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/2670515461 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810fbf0 msgr2=0x7f7f58114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:51.442 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.438+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/2670515461 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810fbf0 0x7f7f58114c30 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=18412979673562875665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f400099a0 tx=0x7f7f4002ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:51.442 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.438+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/2670515461 shutdown_connections 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.438+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/2670515461 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f58115410 0x7f7f58175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.438+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/2670515461 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810fbf0 0x7f7f58114c30 unknown :-1 s=CLOSED pgs=431 gs=1 cs=0 l=1 c_cookie=18412979673562875665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.438+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/2670515461 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f5810f200 0x7f7f5810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.438+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/2670515461 >> 10.20.193.70:0/2670515461 conn(0x7f7f580ecb00 msgr2=0x7f7f5810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.438+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/2670515461 shutdown_connections 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.438+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/2670515461 wait complete. 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 Processor -- start 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 -- start start 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810f200 0x7f7f580f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f58115410 0x7f7f58175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:51.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f580f5310 0x7f7f580fa5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7f580f5a00 con 0x7f7f5810f200 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7f580fab20 con 0x7f7f580f5310 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7f580face0 con 0x7f7f58115410 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5cdf56c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810f200 0x7f7f580f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5cdf56c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810f200 0x7f7f580f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:60808/0 (socket says 10.20.193.70:60808) 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5cdf56c0 1 -- 10.20.193.70:0/1626178085 learned_addr learned my addr 10.20.193.70:0/1626178085 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5cdf56c0 1 -- 10.20.193.70:0/1626178085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f58115410 msgr2=0x7f7f58175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5cdf56c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f58115410 0x7f7f58175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5cdf56c0 1 -- 10.20.193.70:0/1626178085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f580f5310 msgr2=0x7f7f580fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5cdf56c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f580f5310 0x7f7f580fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5cdf56c0 1 -- 10.20.193.70:0/1626178085 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f40009590 con 0x7f7f5810f200 2026-02-13T03:48:51.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5cdf56c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810f200 0x7f7f580f4ce0 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f4800b710 tx=0x7f7f4800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:51.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f4dffb6c0 1 -- 10.20.193.70:0/1626178085 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f48004250 con 0x7f7f5810f200 2026-02-13T03:48:51.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f4dffb6c0 1 -- 10.20.193.70:0/1626178085 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7f48002d80 con 0x7f7f5810f200 2026-02-13T03:48:51.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f580fafc0 con 0x7f7f5810f200 2026-02-13T03:48:51.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f4dffb6c0 1 -- 10.20.193.70:0/1626178085 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f4800cda0 con 0x7f7f5810f200 2026-02-13T03:48:51.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.439+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f580fb750 con 0x7f7f5810f200 2026-02-13T03:48:51.445 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.440+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f581104d0 con 0x7f7f5810f200 2026-02-13T03:48:51.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.441+0000 7f7f4dffb6c0 1 -- 10.20.193.70:0/1626178085 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f7f480028c0 con 0x7f7f5810f200 2026-02-13T03:48:51.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.442+0000 7f7f4dffb6c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7f340b5680 0x7f7f340d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:51.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.442+0000 7f7f4ffff6c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7f340b5680 0x7f7f340d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:51.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.442+0000 7f7f4dffb6c0 1 -- 10.20.193.70:0/1626178085 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f7f480e3ad0 con 0x7f7f5810f200 2026-02-13T03:48:51.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.442+0000 7f7f4ffff6c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7f340b5680 0x7f7f340d5b30 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f400092e0 tx=0x7f7f40005c60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:51.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.442+0000 7f7f4dffb6c0 1 -- 10.20.193.70:0/1626178085 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7f480a6550 con 0x7f7f5810f200 2026-02-13T03:48:51.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.562+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7f5810f5d0 con 0x7f7f5810f200 2026-02-13T03:48:51.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.562+0000 7f7f4dffb6c0 1 -- 10.20.193.70:0/1626178085 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7f480a9700 con 0x7f7f5810f200 2026-02-13T03:48:51.564 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:51.564 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:51.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7f340b5680 msgr2=0x7f7f340d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:51.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7f340b5680 0x7f7f340d5b30 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f400092e0 tx=0x7f7f40005c60 comp rx=0 tx=0).stop 2026-02-13T03:48:51.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810f200 msgr2=0x7f7f580f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:51.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810f200 0x7f7f580f4ce0 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f4800b710 tx=0x7f7f4800bbe0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 shutdown_connections 2026-02-13T03:48:51.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f7f340b5680 0x7f7f340d5b30 unknown :-1 s=CLOSED pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f7f580f5310 0x7f7f580fa5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f58115410 0x7f7f58175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 --2- 10.20.193.70:0/1626178085 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7f5810f200 0x7f7f580f4ce0 unknown :-1 s=CLOSED pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:51.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 >> 10.20.193.70:0/1626178085 conn(0x7f7f580ecb00 msgr2=0x7f7f5810d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:51.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 shutdown_connections 2026-02-13T03:48:51.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:51.564+0000 7f7f5f0846c0 1 -- 10.20.193.70:0/1626178085 wait complete. 2026-02-13T03:48:52.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:52 trial127 ceph-mon[26439]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:52.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:52 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1626178085' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:52 trial070 ceph-mon[24757]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:52 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1626178085' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:52.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:52 trial177 ceph-mon[27082]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:52.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:52 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1626178085' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:54.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:54 trial127 ceph-mon[26439]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:54 trial070 ceph-mon[24757]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:54.609 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:54.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:54 trial177 ceph-mon[27082]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:54.728 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:54.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 -- 10.20.193.70:0/3470128136 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010fc20 msgr2=0x7fe050114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:54.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/3470128136 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010fc20 0x7fe050114c60 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=455704464538041718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0380099a0 tx=0x7fe03802ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:54.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 -- 10.20.193.70:0/3470128136 shutdown_connections 2026-02-13T03:48:54.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/3470128136 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe050115440 0x7fe050175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:54.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/3470128136 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010fc20 0x7fe050114c60 unknown :-1 s=CLOSED pgs=433 gs=1 cs=0 l=1 c_cookie=455704464538041718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:54.856 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/3470128136 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe05010f230 0x7fe05010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 -- 10.20.193.70:0/3470128136 >> 10.20.193.70:0/3470128136 conn(0x7fe0500ecb30 msgr2=0x7fe05010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 -- 10.20.193.70:0/3470128136 shutdown_connections 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 -- 10.20.193.70:0/3470128136 wait complete. 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 Processor -- start 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 -- start start 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010f230 0x7fe0500f4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe050115440 0x7fe050175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0500f5330 0x7fe0500fa5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0500f5a20 con 0x7fe05010f230 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe0500faaf0 con 0x7fe0500f5330 2026-02-13T03:48:54.857 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe0570d86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0500facb0 con 0x7fe050115440 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe054e4d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010f230 0x7fe0500f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe054e4d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010f230 0x7fe0500f4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:60838/0 (socket says 10.20.193.70:60838) 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe054e4d6c0 1 -- 10.20.193.70:0/2562090188 learned_addr learned my addr 10.20.193.70:0/2562090188 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe047fff6c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe050115440 0x7fe050175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe05564e6c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0500f5330 0x7fe0500fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe054e4d6c0 1 -- 10.20.193.70:0/2562090188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe050115440 msgr2=0x7fe050175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe054e4d6c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe050115440 0x7fe050175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe054e4d6c0 1 -- 10.20.193.70:0/2562090188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0500f5330 msgr2=0x7fe0500fa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe054e4d6c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0500f5330 0x7fe0500fa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe054e4d6c0 1 -- 10.20.193.70:0/2562090188 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe038009590 con 0x7fe05010f230 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe05564e6c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0500f5330 0x7fe0500fa5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:54.858 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.852+0000 7fe054e4d6c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010f230 0x7fe0500f4d00 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe04000b6c0 tx=0x7fe04000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:54.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.853+0000 7fe045ffb6c0 1 -- 10.20.193.70:0/2562090188 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0400044a0 con 0x7fe05010f230 2026-02-13T03:48:54.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.853+0000 7fe045ffb6c0 1 -- 10.20.193.70:0/2562090188 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe040009030 con 0x7fe05010f230 2026-02-13T03:48:54.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.853+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0500faf90 con 0x7fe05010f230 2026-02-13T03:48:54.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.853+0000 7fe045ffb6c0 1 -- 10.20.193.70:0/2562090188 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe04000cc10 con 0x7fe05010f230 2026-02-13T03:48:54.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.853+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0500fb720 con 0x7fe05010f230 2026-02-13T03:48:54.859 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.853+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe050110500 con 0x7fe05010f230 2026-02-13T03:48:54.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.855+0000 7fe045ffb6c0 1 -- 10.20.193.70:0/2562090188 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe040005080 con 0x7fe05010f230 2026-02-13T03:48:54.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.855+0000 7fe045ffb6c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe02c0b5680 0x7fe02c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:54.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.855+0000 7fe047fff6c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe02c0b5680 0x7fe02c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:54.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.856+0000 7fe045ffb6c0 1 -- 10.20.193.70:0/2562090188 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fe0400e38a0 con 0x7fe05010f230 2026-02-13T03:48:54.860 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.856+0000 7fe045ffb6c0 1 -- 10.20.193.70:0/2562090188 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe0400e3d20 con 0x7fe05010f230 2026-02-13T03:48:54.861 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.856+0000 7fe047fff6c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe02c0b5680 0x7fe02c0d5b30 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe038005b40 tx=0x7fe038005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:54.976 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.974+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe05010f600 con 0x7fe05010f230 2026-02-13T03:48:54.977 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.975+0000 7fe045ffb6c0 1 -- 10.20.193.70:0/2562090188 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe0400a63b0 con 0x7fe05010f230 2026-02-13T03:48:54.977 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:54.977 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:54.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe02c0b5680 msgr2=0x7fe02c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:54.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe02c0b5680 0x7fe02c0d5b30 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe038005b40 tx=0x7fe038005c20 comp rx=0 tx=0).stop 2026-02-13T03:48:54.978 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010f230 msgr2=0x7fe0500f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:54.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010f230 0x7fe0500f4d00 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe04000b6c0 tx=0x7fe04000bb90 comp rx=0 tx=0).stop 2026-02-13T03:48:54.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 shutdown_connections 2026-02-13T03:48:54.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe02c0b5680 0x7fe02c0d5b30 unknown :-1 s=CLOSED pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:54.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe0500f5330 0x7fe0500fa5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:54.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe050115440 0x7fe050175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:54.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 --2- 10.20.193.70:0/2562090188 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe05010f230 0x7fe0500f4d00 unknown :-1 s=CLOSED pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:54.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 >> 10.20.193.70:0/2562090188 conn(0x7fe0500ecb30 msgr2=0x7fe05010d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:54.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 shutdown_connections 2026-02-13T03:48:54.979 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:54.976+0000 7fe0570d86c0 1 -- 10.20.193.70:0/2562090188 wait complete. 2026-02-13T03:48:55.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:55 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2562090188' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:55.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:55 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2562090188' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:55.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:55 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2562090188' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:56.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:56 trial127 ceph-mon[26439]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:56.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:56 trial070 ceph-mon[24757]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:56.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:56 trial177 ceph-mon[27082]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:48:58.021 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:48:58.141 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:48:58.263 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 -- 10.20.193.70:0/2286354013 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc10cfa0 msgr2=0x7f6ddc10d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:58.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/2286354013 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc10cfa0 0x7f6ddc10d370 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=5586192028422285957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dc40099a0 tx=0x7f6dc402ed20 comp rx=0 tx=0).stop 2026-02-13T03:48:58.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 -- 10.20.193.70:0/2286354013 shutdown_connections 2026-02-13T03:48:58.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/2286354013 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ddc1131b0 0x7f6ddc173b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:58.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/2286354013 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ddc10d990 0x7f6ddc1129d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:58.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/2286354013 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc10cfa0 0x7f6ddc10d370 unknown :-1 s=CLOSED pgs=435 gs=1 cs=0 l=1 c_cookie=5586192028422285957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:58.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 -- 10.20.193.70:0/2286354013 >> 10.20.193.70:0/2286354013 conn(0x7f6ddc0ea8e0 msgr2=0x7f6ddc10acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:58.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 -- 10.20.193.70:0/2286354013 shutdown_connections 2026-02-13T03:48:58.264 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 -- 10.20.193.70:0/2286354013 wait complete. 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 Processor -- start 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.259+0000 7f6de462f6c0 1 -- start start 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de462f6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ddc10cfa0 0x7f6ddc11b070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de462f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc1131b0 0x7f6ddc11b5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de462f6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ddc120970 0x7f6ddc120e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de462f6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc121380 con 0x7f6ddc1131b0 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de462f6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc1214f0 con 0x7f6ddc120970 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de462f6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc1216b0 con 0x7f6ddc10cfa0 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de1b9f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc1131b0 0x7f6ddc11b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de1b9f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc1131b0 0x7f6ddc11b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53546/0 (socket says 10.20.193.70:53546) 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de1b9f6c0 1 -- 10.20.193.70:0/1985487066 learned_addr learned my addr 10.20.193.70:0/1985487066 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:48:58.265 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de2ba16c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ddc120970 0x7f6ddc120e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de23a06c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ddc10cfa0 0x7f6ddc11b070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de1b9f6c0 1 -- 10.20.193.70:0/1985487066 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ddc10cfa0 msgr2=0x7f6ddc11b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de1b9f6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ddc10cfa0 0x7f6ddc11b070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de1b9f6c0 1 -- 10.20.193.70:0/1985487066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ddc120970 msgr2=0x7f6ddc120e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de1b9f6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ddc120970 0x7f6ddc120e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de1b9f6c0 1 -- 10.20.193.70:0/1985487066 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc4009590 con 0x7f6ddc1131b0 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de23a06c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ddc10cfa0 0x7f6ddc11b070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de1b9f6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc1131b0 0x7f6ddc11b5b0 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dcc00b6c0 tx=0x7f6dcc00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6dd37fe6c0 1 -- 10.20.193.70:0/1985487066 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6dcc004250 con 0x7f6ddc1131b0 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6dd37fe6c0 1 -- 10.20.193.70:0/1985487066 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6dcc009070 con 0x7f6ddc1131b0 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ddc161b60 con 0x7f6ddc1131b0 2026-02-13T03:48:58.266 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6dd37fe6c0 1 -- 10.20.193.70:0/1985487066 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6dcc00ccb0 con 0x7f6ddc1131b0 2026-02-13T03:48:58.267 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ddc161ff0 con 0x7f6ddc1131b0 2026-02-13T03:48:58.267 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.260+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ddc10e270 con 0x7f6ddc1131b0 2026-02-13T03:48:58.267 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.262+0000 7f6dd37fe6c0 1 -- 10.20.193.70:0/1985487066 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f6dcc0028c0 con 0x7f6ddc1131b0 2026-02-13T03:48:58.268 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.262+0000 7f6dd37fe6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6db80b5600 0x7f6db80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:48:58.268 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.262+0000 7f6dd37fe6c0 1 -- 10.20.193.70:0/1985487066 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f6dcc0e3b20 con 0x7f6ddc1131b0 2026-02-13T03:48:58.268 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.262+0000 7f6de23a06c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6db80b5600 0x7f6db80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:48:58.268 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.263+0000 7f6dd37fe6c0 1 -- 10.20.193.70:0/1985487066 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6dcc0a65a0 con 0x7f6ddc1131b0 2026-02-13T03:48:58.268 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.263+0000 7f6de23a06c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6db80b5600 0x7f6db80d5ab0 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dc40098c0 tx=0x7f6dc402f580 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:48:58.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:58 trial070 ceph-mon[24757]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:58.383 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.381+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6ddc10d370 con 0x7f6ddc1131b0 2026-02-13T03:48:58.384 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.382+0000 7f6dd37fe6c0 1 -- 10.20.193.70:0/1985487066 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6dcc0a9750 con 0x7f6ddc1131b0 2026-02-13T03:48:58.384 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:48:58.384 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:48:58.385 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.382+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6db80b5600 msgr2=0x7f6db80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:58.385 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.382+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6db80b5600 0x7f6db80d5ab0 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dc40098c0 tx=0x7f6dc402f580 comp rx=0 tx=0).stop 2026-02-13T03:48:58.385 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.382+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc1131b0 msgr2=0x7f6ddc11b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:48:58.385 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.382+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc1131b0 0x7f6ddc11b5b0 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dcc00b6c0 tx=0x7f6dcc00bb90 comp rx=0 tx=0).stop 2026-02-13T03:48:58.386 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.383+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 shutdown_connections 2026-02-13T03:48:58.386 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.383+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f6db80b5600 0x7f6db80d5ab0 unknown :-1 s=CLOSED pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:58.386 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.383+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f6ddc120970 0x7f6ddc120e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:58.386 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.383+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f6ddc1131b0 0x7f6ddc11b5b0 unknown :-1 s=CLOSED pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:58.386 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.383+0000 7f6de462f6c0 1 --2- 10.20.193.70:0/1985487066 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ddc10cfa0 0x7f6ddc11b070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:48:58.386 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.383+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 >> 10.20.193.70:0/1985487066 conn(0x7f6ddc0ea8e0 msgr2=0x7f6ddc10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:48:58.386 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.383+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 shutdown_connections 2026-02-13T03:48:58.386 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:48:58.383+0000 7f6de462f6c0 1 -- 10.20.193.70:0/1985487066 wait complete. 2026-02-13T03:48:58.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:58 trial127 ceph-mon[26439]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:58.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:58 trial177 ceph-mon[27082]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:48:59.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:48:59 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1985487066' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:59.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:48:59 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1985487066' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:48:59.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:48:59 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1985487066' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:00.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:00 trial127 ceph-mon[26439]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:00.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:00 trial070 ceph-mon[24757]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:00.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:00 trial177 ceph-mon[27082]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:01.428 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:01.547 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:01.665 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.661+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1148125062 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c10f230 msgr2=0x7fb68c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.661+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1148125062 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c10f230 0x7fb68c10f600 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=3649623525860752377 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb6800099a0 tx=0x7fb68002ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1148125062 shutdown_connections 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1148125062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb68c115440 0x7fb68c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1148125062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb68c10fc20 0x7fb68c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1148125062 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c10f230 0x7fb68c10f600 unknown :-1 s=CLOSED pgs=437 gs=1 cs=0 l=1 c_cookie=3649623525860752377 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1148125062 >> 10.20.193.70:0/1148125062 conn(0x7fb68c0ecb30 msgr2=0x7fb68c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1148125062 shutdown_connections 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1148125062 wait complete. 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 Processor -- start 2026-02-13T03:49:01.666 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 -- start start 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb68c10f230 0x7fb68c11d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb68c115440 0x7fb68c11d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c122c20 0x7fb68c1230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c123630 con 0x7fb68c122c20 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c1237a0 con 0x7fb68c115440 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb690d2c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c123960 con 0x7fb68c10f230 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68ad766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c122c20 0x7fb68c1230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68ad766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c122c20 0x7fb68c1230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53562/0 (socket says 10.20.193.70:53562) 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68ad766c0 1 -- 10.20.193.70:0/1320006423 learned_addr learned my addr 10.20.193.70:0/1320006423 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68a5756c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb68c10f230 0x7fb68c11d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb689d746c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb68c115440 0x7fb68c11d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:01.667 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68ad766c0 1 -- 10.20.193.70:0/1320006423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb68c10f230 msgr2=0x7fb68c11d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68ad766c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb68c10f230 0x7fb68c11d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68ad766c0 1 -- 10.20.193.70:0/1320006423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb68c115440 msgr2=0x7fb68c11d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68ad766c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb68c115440 0x7fb68c11d860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68ad766c0 1 -- 10.20.193.70:0/1320006423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb680009590 con 0x7fb68c122c20 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.662+0000 7fb68ad766c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c122c20 0x7fb68c1230c0 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb67c006ea0 tx=0x7fb67c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.663+0000 7fb6737fe6c0 1 -- 10.20.193.70:0/1320006423 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb67c003a30 con 0x7fb68c122c20 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.663+0000 7fb6737fe6c0 1 -- 10.20.193.70:0/1320006423 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb67c0054f0 con 0x7fb68c122c20 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.663+0000 7fb6737fe6c0 1 -- 10.20.193.70:0/1320006423 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb67c00dcd0 con 0x7fb68c122c20 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.663+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68c163e10 con 0x7fb68c122c20 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.663+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68c1642a0 con 0x7fb68c122c20 2026-02-13T03:49:01.668 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.663+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb68c110500 con 0x7fb68c122c20 2026-02-13T03:49:01.669 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.665+0000 7fb6737fe6c0 1 -- 10.20.193.70:0/1320006423 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fb67c005030 con 0x7fb68c122c20 2026-02-13T03:49:01.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.665+0000 7fb6737fe6c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6640b5680 0x7fb6640d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:01.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.665+0000 7fb68a5756c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6640b5680 0x7fb6640d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:01.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.665+0000 7fb6737fe6c0 1 -- 10.20.193.70:0/1320006423 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fb67c0e4ab0 con 0x7fb68c122c20 2026-02-13T03:49:01.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.666+0000 7fb6737fe6c0 1 -- 10.20.193.70:0/1320006423 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb67c0aa500 con 0x7fb68c122c20 2026-02-13T03:49:01.670 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.666+0000 7fb68a5756c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6640b5680 0x7fb6640d5b30 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb680005b40 tx=0x7fb6800023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:01.786 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.784+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb68c10f600 con 0x7fb68c122c20 2026-02-13T03:49:01.786 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.784+0000 7fb6737fe6c0 1 -- 10.20.193.70:0/1320006423 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb67c0aa6e0 con 0x7fb68c122c20 2026-02-13T03:49:01.786 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:01.786 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:01.787 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6640b5680 msgr2=0x7fb6640d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6640b5680 0x7fb6640d5b30 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb680005b40 tx=0x7fb6800023a0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c122c20 msgr2=0x7fb68c1230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c122c20 0x7fb68c1230c0 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb67c006ea0 tx=0x7fb67c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 shutdown_connections 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb6640b5680 0x7fb6640d5b30 unknown :-1 s=CLOSED pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb68c122c20 0x7fb68c1230c0 unknown :-1 s=CLOSED pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb68c115440 0x7fb68c11d860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 --2- 10.20.193.70:0/1320006423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb68c10f230 0x7fb68c11d320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 >> 10.20.193.70:0/1320006423 conn(0x7fb68c0ecb30 msgr2=0x7fb68c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:01.788 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 shutdown_connections 2026-02-13T03:49:01.789 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:01.785+0000 7fb690d2c6c0 1 -- 10.20.193.70:0/1320006423 wait complete. 2026-02-13T03:49:02.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:02 trial127 ceph-mon[26439]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:02.474 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:02 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1320006423' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:02.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:02 trial070 ceph-mon[24757]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:02.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:02 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1320006423' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:02.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:02 trial177 ceph-mon[27082]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:02.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:02 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1320006423' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:04.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:04 trial127 ceph-mon[26439]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:04.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:04 trial070 ceph-mon[24757]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:04.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:04 trial177 ceph-mon[27082]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:04.831 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:04.951 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:05.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 -- 10.20.193.70:0/3818258918 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe834115440 msgr2=0x7fe834175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:05.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/3818258918 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe834115440 0x7fe834175de0 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=12920182635269831778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe82800aa70 tx=0x7fe82802fde0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 -- 10.20.193.70:0/3818258918 shutdown_connections 2026-02-13T03:49:05.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/3818258918 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe834115440 0x7fe834175de0 unknown :-1 s=CLOSED pgs=439 gs=1 cs=0 l=1 c_cookie=12920182635269831778 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/3818258918 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe83410fc20 0x7fe834114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/3818258918 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe83410f230 0x7fe83410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.073 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 -- 10.20.193.70:0/3818258918 >> 10.20.193.70:0/3818258918 conn(0x7fe8340ecb30 msgr2=0x7fe83410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 -- 10.20.193.70:0/3818258918 shutdown_connections 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 -- 10.20.193.70:0/3818258918 wait complete. 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 Processor -- start 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 -- start start 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe83410f230 0x7fe8340f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe834115440 0x7fe834175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe8340f51f0 0x7fe8340fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8340f58e0 con 0x7fe8340f51f0 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe8340faa00 con 0x7fe834115440 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83c9856c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe8340fabc0 con 0x7fe83410f230 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83aef76c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe8340f51f0 0x7fe8340fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:05.074 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83aef76c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe8340f51f0 0x7fe8340fa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53582/0 (socket says 10.20.193.70:53582) 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.069+0000 7fe83aef76c0 1 -- 10.20.193.70:0/1487418026 learned_addr learned my addr 10.20.193.70:0/1487418026 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83a6f66c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe83410f230 0x7fe8340f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe839ef56c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe834115440 0x7fe834175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83aef76c0 1 -- 10.20.193.70:0/1487418026 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe83410f230 msgr2=0x7fe8340f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83aef76c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe83410f230 0x7fe8340f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83aef76c0 1 -- 10.20.193.70:0/1487418026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe834115440 msgr2=0x7fe834175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83aef76c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe834115440 0x7fe834175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83aef76c0 1 -- 10.20.193.70:0/1487418026 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82800a660 con 0x7fe8340f51f0 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83aef76c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe8340f51f0 0x7fe8340fa4c0 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8280054b0 tx=0x7fe8280054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe81f7fe6c0 1 -- 10.20.193.70:0/1487418026 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe828003a30 con 0x7fe8340f51f0 2026-02-13T03:49:05.075 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe81f7fe6c0 1 -- 10.20.193.70:0/1487418026 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe828003b90 con 0x7fe8340f51f0 2026-02-13T03:49:05.076 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8340fae40 con 0x7fe8340f51f0 2026-02-13T03:49:05.076 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe81f7fe6c0 1 -- 10.20.193.70:0/1487418026 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8280382f0 con 0x7fe8340f51f0 2026-02-13T03:49:05.076 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8340fb2c0 con 0x7fe8340f51f0 2026-02-13T03:49:05.076 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.070+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe834110500 con 0x7fe8340f51f0 2026-02-13T03:49:05.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.072+0000 7fe81f7fe6c0 1 -- 10.20.193.70:0/1487418026 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe828008260 con 0x7fe8340f51f0 2026-02-13T03:49:05.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.072+0000 7fe81f7fe6c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8100b5680 0x7fe8100d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:05.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.072+0000 7fe83a6f66c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8100b5680 0x7fe8100d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:05.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.073+0000 7fe81f7fe6c0 1 -- 10.20.193.70:0/1487418026 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fe828108cb0 con 0x7fe8340f51f0 2026-02-13T03:49:05.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.073+0000 7fe83a6f66c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8100b5680 0x7fe8100d5b30 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe82c004750 tx=0x7fe82c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:05.077 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.073+0000 7fe81f7fe6c0 1 -- 10.20.193.70:0/1487418026 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe8280cb730 con 0x7fe8340f51f0 2026-02-13T03:49:05.193 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.191+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe8340f5d10 con 0x7fe8340f51f0 2026-02-13T03:49:05.194 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.191+0000 7fe81f7fe6c0 1 -- 10.20.193.70:0/1487418026 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe8280ce8e0 con 0x7fe8340f51f0 2026-02-13T03:49:05.194 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:05.194 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:05.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8100b5680 msgr2=0x7fe8100d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:05.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8100b5680 0x7fe8100d5b30 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe82c004750 tx=0x7fe82c009260 comp rx=0 tx=0).stop 2026-02-13T03:49:05.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe8340f51f0 msgr2=0x7fe8340fa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:05.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe8340f51f0 0x7fe8340fa4c0 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8280054b0 tx=0x7fe8280054e0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 shutdown_connections 2026-02-13T03:49:05.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe8100b5680 0x7fe8100d5b30 unknown :-1 s=CLOSED pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.195 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe8340f51f0 0x7fe8340fa4c0 unknown :-1 s=CLOSED pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.196 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe834115440 0x7fe834175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.196 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 --2- 10.20.193.70:0/1487418026 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe83410f230 0x7fe8340f4bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:05.196 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 >> 10.20.193.70:0/1487418026 conn(0x7fe8340ecb30 msgr2=0x7fe83410d850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:05.196 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 shutdown_connections 2026-02-13T03:49:05.196 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:05.193+0000 7fe83c9856c0 1 -- 10.20.193.70:0/1487418026 wait complete. 2026-02-13T03:49:05.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:05 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1487418026' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:05.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:05 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1487418026' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:05.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:05 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1487418026' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:06.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:06 trial127 ceph-mon[26439]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:06.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:06 trial070 ceph-mon[24757]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:06.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:06 trial177 ceph-mon[27082]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:08.237 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:08.358 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:08.473 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:08 trial127 ceph-mon[26439]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:08.474 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:08 trial070 ceph-mon[24757]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:08.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 -- 10.20.193.70:0/3704439757 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410e740 msgr2=0x7fd054152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:08.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/3704439757 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410e740 0x7fd054152dc0 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=1883694202409831156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd040009970 tx=0x7fd04002ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:08.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 -- 10.20.193.70:0/3704439757 shutdown_connections 2026-02-13T03:49:08.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/3704439757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd054153300 0x7fd054173720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:08.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/3704439757 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410e740 0x7fd054152dc0 unknown :-1 s=CLOSED pgs=441 gs=1 cs=0 l=1 c_cookie=1883694202409831156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/3704439757 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd05410dd50 0x7fd05410e120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 -- 10.20.193.70:0/3704439757 >> 10.20.193.70:0/3704439757 conn(0x7fd0540e9740 msgr2=0x7fd054109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 -- 10.20.193.70:0/3704439757 shutdown_connections 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 -- 10.20.193.70:0/3704439757 wait complete. 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 Processor -- start 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 -- start start 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410dd50 0x7fd054161e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd05410e740 0x7fd0541623c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd054153300 0x7fd054167780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd054167dd0 con 0x7fd05410dd50 2026-02-13T03:49:08.482 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd054167f40 con 0x7fd05410e740 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05c9806c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd054168100 con 0x7fd054153300 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.477+0000 7fd05a6f56c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410dd50 0x7fd054161e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05a6f56c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410dd50 0x7fd054161e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53760/0 (socket says 10.20.193.70:53760) 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05a6f56c0 1 -- 10.20.193.70:0/1302327848 learned_addr learned my addr 10.20.193.70:0/1302327848 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd059ef46c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd05410e740 0x7fd0541623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05a6f56c0 1 -- 10.20.193.70:0/1302327848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd054153300 msgr2=0x7fd054167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05a6f56c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd054153300 0x7fd054167780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05a6f56c0 1 -- 10.20.193.70:0/1302327848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd05410e740 msgr2=0x7fd0541623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05a6f56c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd05410e740 0x7fd0541623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05a6f56c0 1 -- 10.20.193.70:0/1302327848 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd040009590 con 0x7fd05410dd50 2026-02-13T03:49:08.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd059ef46c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd05410e740 0x7fd0541623c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:49:08.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05a6f56c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410dd50 0x7fd054161e80 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd04c0092e0 tx=0x7fd04c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:08.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd03f7fe6c0 1 -- 10.20.193.70:0/1302327848 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd04c004250 con 0x7fd05410dd50 2026-02-13T03:49:08.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd03f7fe6c0 1 -- 10.20.193.70:0/1302327848 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd04c0043b0 con 0x7fd05410dd50 2026-02-13T03:49:08.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0541683e0 con 0x7fd05410dd50 2026-02-13T03:49:08.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd03f7fe6c0 1 -- 10.20.193.70:0/1302327848 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd04c00cd40 con 0x7fd05410dd50 2026-02-13T03:49:08.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05414ef30 con 0x7fd05410dd50 2026-02-13T03:49:08.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.478+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05405faf0 con 0x7fd05410dd50 2026-02-13T03:49:08.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.480+0000 7fd03f7fe6c0 1 -- 10.20.193.70:0/1302327848 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fd04c0026b0 con 0x7fd05410dd50 2026-02-13T03:49:08.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.480+0000 7fd03f7fe6c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0300b5680 0x7fd0300d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:08.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.480+0000 7fd059ef46c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0300b5680 0x7fd0300d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:08.485 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.481+0000 7fd03f7fe6c0 1 -- 10.20.193.70:0/1302327848 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fd04c0e3950 con 0x7fd05410dd50 2026-02-13T03:49:08.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.481+0000 7fd03f7fe6c0 1 -- 10.20.193.70:0/1302327848 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd04c0a6410 con 0x7fd05410dd50 2026-02-13T03:49:08.486 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.481+0000 7fd059ef46c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0300b5680 0x7fd0300d5b30 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0400098c0 tx=0x7fd040009230 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:08.601 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.598+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd05410e120 con 0x7fd05410dd50 2026-02-13T03:49:08.601 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.599+0000 7fd03f7fe6c0 1 -- 10.20.193.70:0/1302327848 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd04c0a95c0 con 0x7fd05410dd50 2026-02-13T03:49:08.601 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:08.601 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0300b5680 msgr2=0x7fd0300d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0300b5680 0x7fd0300d5b30 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0400098c0 tx=0x7fd040009230 comp rx=0 tx=0).stop 2026-02-13T03:49:08.602 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410dd50 msgr2=0x7fd054161e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410dd50 0x7fd054161e80 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd04c0092e0 tx=0x7fd04c00bc50 comp rx=0 tx=0).stop 2026-02-13T03:49:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 shutdown_connections 2026-02-13T03:49:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0300b5680 0x7fd0300d5b30 unknown :-1 s=CLOSED pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd054153300 0x7fd054167780 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd05410e740 0x7fd0541623c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 --2- 10.20.193.70:0/1302327848 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd05410dd50 0x7fd054161e80 unknown :-1 s=CLOSED pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 >> 10.20.193.70:0/1302327848 conn(0x7fd0540e9740 msgr2=0x7fd054109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 shutdown_connections 2026-02-13T03:49:08.603 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:08.600+0000 7fd05c9806c0 1 -- 10.20.193.70:0/1302327848 wait complete. 2026-02-13T03:49:08.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:08 trial177 ceph-mon[27082]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:09.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:09 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1302327848' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:09.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:09 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1302327848' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:09.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:09 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1302327848' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:10.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:10 trial070 ceph-mon[24757]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:10.624 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:10 trial127 ceph-mon[26439]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:10.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:10 trial177 ceph-mon[27082]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:11.643 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:11.760 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:11.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.871+0000 7f0adad116c0 1 -- 10.20.193.70:0/1973193275 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad410f230 msgr2=0x7f0ad410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:11.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.871+0000 7f0adad116c0 1 --2- 10.20.193.70:0/1973193275 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad410f230 0x7f0ad410f600 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=10750311085797905714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac40099a0 tx=0x7f0ac402ed50 comp rx=0 tx=0).stop 2026-02-13T03:49:11.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.871+0000 7f0adad116c0 1 -- 10.20.193.70:0/1973193275 shutdown_connections 2026-02-13T03:49:11.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.871+0000 7f0adad116c0 1 --2- 10.20.193.70:0/1973193275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ad4115440 0x7f0ad4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.871+0000 7f0adad116c0 1 --2- 10.20.193.70:0/1973193275 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410fc20 0x7f0ad4114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.871+0000 7f0adad116c0 1 --2- 10.20.193.70:0/1973193275 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad410f230 0x7f0ad410f600 unknown :-1 s=CLOSED pgs=443 gs=1 cs=0 l=1 c_cookie=10750311085797905714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.871+0000 7f0adad116c0 1 -- 10.20.193.70:0/1973193275 >> 10.20.193.70:0/1973193275 conn(0x7f0ad40ecb30 msgr2=0x7f0ad410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:11.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.871+0000 7f0adad116c0 1 -- 10.20.193.70:0/1973193275 shutdown_connections 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.871+0000 7f0adad116c0 1 -- 10.20.193.70:0/1973193275 wait complete. 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 Processor -- start 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 -- start start 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410f230 0x7f0ad411d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad4115440 0x7f0ad411d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ad4122c50 0x7f0ad41230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad4123660 con 0x7f0ad4115440 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad41237d0 con 0x7f0ad410f230 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad4123990 con 0x7f0ad4122c50 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0acbfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad4115440 0x7f0ad411d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0acbfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad4115440 0x7f0ad411d890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53774/0 (socket says 10.20.193.70:53774) 2026-02-13T03:49:11.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0acbfff6c0 1 -- 10.20.193.70:0/3912477282 learned_addr learned my addr 10.20.193.70:0/3912477282 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0ad92836c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ad4122c50 0x7f0ad41230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0ad8a826c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410f230 0x7f0ad411d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0acbfff6c0 1 -- 10.20.193.70:0/3912477282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ad4122c50 msgr2=0x7f0ad41230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0acbfff6c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ad4122c50 0x7f0ad41230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0acbfff6c0 1 -- 10.20.193.70:0/3912477282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410f230 msgr2=0x7f0ad411d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0acbfff6c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410f230 0x7f0ad411d350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0acbfff6c0 1 -- 10.20.193.70:0/3912477282 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac4009590 con 0x7f0ad4115440 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0ad92836c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ad4122c50 0x7f0ad41230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0ad8a826c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410f230 0x7f0ad411d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0acbfff6c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad4115440 0x7f0ad411d890 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0abc00b6c0 tx=0x7f0abc00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:11.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0ac9ffb6c0 1 -- 10.20.193.70:0/3912477282 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0abc0044a0 con 0x7f0ad4115440 2026-02-13T03:49:11.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0ac9ffb6c0 1 -- 10.20.193.70:0/3912477282 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0abc00be50 con 0x7f0ad4115440 2026-02-13T03:49:11.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad4163e40 con 0x7f0ad4115440 2026-02-13T03:49:11.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0ac9ffb6c0 1 -- 10.20.193.70:0/3912477282 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0abc00cc90 con 0x7f0ad4115440 2026-02-13T03:49:11.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.872+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad4164320 con 0x7f0ad4115440 2026-02-13T03:49:11.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.873+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad4110500 con 0x7f0ad4115440 2026-02-13T03:49:11.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.874+0000 7f0ac9ffb6c0 1 -- 10.20.193.70:0/3912477282 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f0abc0026b0 con 0x7f0ad4115440 2026-02-13T03:49:11.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.875+0000 7f0ac9ffb6c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ab00b5680 0x7f0ab00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:11.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.875+0000 7f0ad8a826c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ab00b5680 0x7f0ab00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:11.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.875+0000 7f0ac9ffb6c0 1 -- 10.20.193.70:0/3912477282 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f0abc0e3850 con 0x7f0ad4115440 2026-02-13T03:49:11.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.875+0000 7f0ac9ffb6c0 1 -- 10.20.193.70:0/3912477282 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0abc0a9d30 con 0x7f0ad4115440 2026-02-13T03:49:11.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.875+0000 7f0ad8a826c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ab00b5680 0x7f0ab00d5b30 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac40098c0 tx=0x7f0ac4005ae0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:11.995 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.993+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0ad411e4d0 con 0x7f0ad4115440 2026-02-13T03:49:11.996 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.993+0000 7f0ac9ffb6c0 1 -- 10.20.193.70:0/3912477282 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0abc0a9480 con 0x7f0ad4115440 2026-02-13T03:49:11.996 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:11.996 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:11.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ab00b5680 msgr2=0x7f0ab00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:11.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ab00b5680 0x7f0ab00d5b30 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac40098c0 tx=0x7f0ac4005ae0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad4115440 msgr2=0x7f0ad411d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:11.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad4115440 0x7f0ad411d890 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0abc00b6c0 tx=0x7f0abc00bb90 comp rx=0 tx=0).stop 2026-02-13T03:49:11.997 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 shutdown_connections 2026-02-13T03:49:11.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ab00b5680 0x7f0ab00d5b30 unknown :-1 s=CLOSED pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ad4122c50 0x7f0ad41230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0ad4115440 0x7f0ad411d890 unknown :-1 s=CLOSED pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 --2- 10.20.193.70:0/3912477282 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0ad410f230 0x7f0ad411d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:11.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 >> 10.20.193.70:0/3912477282 conn(0x7f0ad40ecb30 msgr2=0x7f0ad410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:11.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 shutdown_connections 2026-02-13T03:49:11.998 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:11.994+0000 7f0adad116c0 1 -- 10.20.193.70:0/3912477282 wait complete. 2026-02-13T03:49:12.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:12 trial070 ceph-mon[24757]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:12.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:12 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3912477282' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:12.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:12 trial177 ceph-mon[27082]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:12.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:12 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3912477282' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:12.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:12 trial127 ceph-mon[26439]: pgmap v305: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:12.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:12 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3912477282' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:14.503 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:14 trial177 ceph-mon[27082]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:14.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:14 trial070 ceph-mon[24757]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:14.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:14 trial127 ceph-mon[26439]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:15.061 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:15.180 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:15.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 -- 10.20.193.70:0/2826452280 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb12810fc20 msgr2=0x7fb128114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:15.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/2826452280 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb12810fc20 0x7fb128114c60 secure :-1 s=READY pgs=445 gs=1 cs=0 l=1 c_cookie=11280441336100093865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1100099a0 tx=0x7fb11002ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:15.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 -- 10.20.193.70:0/2826452280 shutdown_connections 2026-02-13T03:49:15.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/2826452280 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb128115440 0x7fb128175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/2826452280 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb12810fc20 0x7fb128114c60 unknown :-1 s=CLOSED pgs=445 gs=1 cs=0 l=1 c_cookie=11280441336100093865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/2826452280 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb12810f230 0x7fb12810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 -- 10.20.193.70:0/2826452280 >> 10.20.193.70:0/2826452280 conn(0x7fb1280ecb30 msgr2=0x7fb12810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:15.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 -- 10.20.193.70:0/2826452280 shutdown_connections 2026-02-13T03:49:15.293 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 -- 10.20.193.70:0/2826452280 wait complete. 2026-02-13T03:49:15.294 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 Processor -- start 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 -- start start 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb12810f230 0x7fb1280f4d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb128115440 0x7fb128175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1280f5390 0x7fb1280fa660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb1280f5a80 con 0x7fb128115440 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fb1280faba0 con 0x7fb12810f230 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12f0406c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb1280fad60 con 0x7fb1280f5390 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb11ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb128115440 0x7fb128175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb11ffff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb128115440 0x7fb128175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:53804/0 (socket says 10.20.193.70:53804) 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb11ffff6c0 1 -- 10.20.193.70:0/3074059079 learned_addr learned my addr 10.20.193.70:0/3074059079 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.291+0000 7fb12d5b26c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1280f5390 0x7fb1280fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb11ffff6c0 1 -- 10.20.193.70:0/3074059079 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1280f5390 msgr2=0x7fb1280fa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb11ffff6c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1280f5390 0x7fb1280fa660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb11ffff6c0 1 -- 10.20.193.70:0/3074059079 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb12810f230 msgr2=0x7fb1280f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb11ffff6c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb12810f230 0x7fb1280f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb11ffff6c0 1 -- 10.20.193.70:0/3074059079 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb110009590 con 0x7fb128115440 2026-02-13T03:49:15.295 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb12d5b26c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1280f5390 0x7fb1280fa660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb11ffff6c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb128115440 0x7fb128175ce0 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1100023c0 tx=0x7fb11002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb11dffb6c0 1 -- 10.20.193.70:0/3074059079 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb110002ae0 con 0x7fb128115440 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb11dffb6c0 1 -- 10.20.193.70:0/3074059079 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb110002c40 con 0x7fb128115440 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb11dffb6c0 1 -- 10.20.193.70:0/3074059079 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1100372f0 con 0x7fb128115440 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1280fafe0 con 0x7fb128115440 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1280fb410 con 0x7fb128115440 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.292+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb128110500 con 0x7fb128115440 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.294+0000 7fb11dffb6c0 1 -- 10.20.193.70:0/3074059079 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fb110007810 con 0x7fb128115440 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.294+0000 7fb11dffb6c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1040b5680 0x7fb1040d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.294+0000 7fb12cdb16c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1040b5680 0x7fb1040d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:15.296 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.294+0000 7fb11dffb6c0 1 -- 10.20.193.70:0/3074059079 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fb110107b70 con 0x7fb128115440 2026-02-13T03:49:15.297 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.295+0000 7fb11dffb6c0 1 -- 10.20.193.70:0/3074059079 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb1100ca5f0 con 0x7fb128115440 2026-02-13T03:49:15.297 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.295+0000 7fb12cdb16c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1040b5680 0x7fb1040d5b30 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb118005980 tx=0x7fb118005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:15.415 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.413+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb12810f600 con 0x7fb128115440 2026-02-13T03:49:15.415 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.413+0000 7fb11dffb6c0 1 -- 10.20.193.70:0/3074059079 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb110007e60 con 0x7fb128115440 2026-02-13T03:49:15.416 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:15.416 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:15.417 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.414+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1040b5680 msgr2=0x7fb1040d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:15.417 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.414+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1040b5680 0x7fb1040d5b30 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb118005980 tx=0x7fb118005910 comp rx=0 tx=0).stop 2026-02-13T03:49:15.417 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb128115440 msgr2=0x7fb128175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:15.417 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb128115440 0x7fb128175ce0 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1100023c0 tx=0x7fb11002fbf0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.417 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 shutdown_connections 2026-02-13T03:49:15.417 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fb1040b5680 0x7fb1040d5b30 unknown :-1 s=CLOSED pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.417 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb1280f5390 0x7fb1280fa660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.417 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fb128115440 0x7fb128175ce0 unknown :-1 s=CLOSED pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.418 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 --2- 10.20.193.70:0/3074059079 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fb12810f230 0x7fb1280f4d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:15.418 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 >> 10.20.193.70:0/3074059079 conn(0x7fb1280ecb30 msgr2=0x7fb12810da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:15.418 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 shutdown_connections 2026-02-13T03:49:15.418 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:15.415+0000 7fb12f0406c0 1 -- 10.20.193.70:0/3074059079 wait complete. 2026-02-13T03:49:16.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:16 trial070 ceph-mon[24757]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:16.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:16 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3074059079' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:16.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:16 trial177 ceph-mon[27082]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:16.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:16 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3074059079' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:16.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:16 trial127 ceph-mon[26439]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:16.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:16 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3074059079' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:18.459 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:18.486 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:18 trial070 ceph-mon[24757]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:18.578 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:18.695 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 -- 10.20.193.70:0/1511206822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0115410 msgr2=0x7f15e0175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:18.695 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 --2- 10.20.193.70:0/1511206822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0115410 0x7f15e0175db0 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=17338020213114467246 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15d000aa70 tx=0x7f15d002fde0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.695 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 -- 10.20.193.70:0/1511206822 shutdown_connections 2026-02-13T03:49:18.695 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 --2- 10.20.193.70:0/1511206822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0115410 0x7f15e0175db0 unknown :-1 s=CLOSED pgs=447 gs=1 cs=0 l=1 c_cookie=17338020213114467246 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.695 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 --2- 10.20.193.70:0/1511206822 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15e010fbf0 0x7f15e0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.695 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 --2- 10.20.193.70:0/1511206822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15e010f200 0x7f15e010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.695 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 -- 10.20.193.70:0/1511206822 >> 10.20.193.70:0/1511206822 conn(0x7f15e00ecb00 msgr2=0x7f15e010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:18.695 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 -- 10.20.193.70:0/1511206822 shutdown_connections 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 -- 10.20.193.70:0/1511206822 wait complete. 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 Processor -- start 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 -- start start 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15e010f200 0x7f15e011d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15e0115410 0x7f15e011d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0122ad0 0x7f15e0122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15e01234e0 con 0x7f15e0122ad0 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0123650 con 0x7f15e010f200 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.690+0000 7f15e57036c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0123810 con 0x7f15e0115410 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15df7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0122ad0 0x7f15e0122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15df7fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0122ad0 0x7f15e0122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:54162/0 (socket says 10.20.193.70:54162) 2026-02-13T03:49:18.696 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15df7fe6c0 1 -- 10.20.193.70:0/832560900 learned_addr learned my addr 10.20.193.70:0/832560900 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15df7fe6c0 1 -- 10.20.193.70:0/832560900 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15e0115410 msgr2=0x7f15e011d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15de7fc6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15e0115410 0x7f15e011d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15deffd6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15e010f200 0x7f15e011d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15df7fe6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15e0115410 0x7f15e011d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15df7fe6c0 1 -- 10.20.193.70:0/832560900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15e010f200 msgr2=0x7f15e011d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15df7fe6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15e010f200 0x7f15e011d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15df7fe6c0 1 -- 10.20.193.70:0/832560900 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d000a660 con 0x7f15e0122ad0 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15de7fc6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15e0115410 0x7f15e011d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15deffd6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15e010f200 0x7f15e011d1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15df7fe6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0122ad0 0x7f15e0122f70 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15d00052a0 tx=0x7f15d00052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:18.697 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15bffff6c0 1 -- 10.20.193.70:0/832560900 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15d0003a30 con 0x7f15e0122ad0 2026-02-13T03:49:18.698 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15bffff6c0 1 -- 10.20.193.70:0/832560900 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f15d00057c0 con 0x7f15e0122ad0 2026-02-13T03:49:18.698 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15bffff6c0 1 -- 10.20.193.70:0/832560900 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15d0038070 con 0x7f15e0122ad0 2026-02-13T03:49:18.698 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e0163c60 con 0x7f15e0122ad0 2026-02-13T03:49:18.698 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e0164090 con 0x7f15e0122ad0 2026-02-13T03:49:18.698 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.691+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e01104d0 con 0x7f15e0122ad0 2026-02-13T03:49:18.698 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.693+0000 7f15bffff6c0 1 -- 10.20.193.70:0/832560900 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f15d0003b90 con 0x7f15e0122ad0 2026-02-13T03:49:18.699 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.693+0000 7f15bffff6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f15b40b5600 0x7f15b40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:18.699 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.693+0000 7f15bffff6c0 1 -- 10.20.193.70:0/832560900 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f15d0108d90 con 0x7f15e0122ad0 2026-02-13T03:49:18.699 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.693+0000 7f15deffd6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f15b40b5600 0x7f15b40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:18.699 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.694+0000 7f15bffff6c0 1 -- 10.20.193.70:0/832560900 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f15d00cf270 con 0x7f15e0122ad0 2026-02-13T03:49:18.699 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.694+0000 7f15deffd6c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f15b40b5600 0x7f15b40d5ab0 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15d4004750 tx=0x7f15d4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:18.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:18 trial177 ceph-mon[27082]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:18.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:18 trial127 ceph-mon[26439]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:18.813 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.810+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f15e010f5d0 con 0x7f15e0122ad0 2026-02-13T03:49:18.813 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.811+0000 7f15bffff6c0 1 -- 10.20.193.70:0/832560900 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f15d0095840 con 0x7f15e0122ad0 2026-02-13T03:49:18.813 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:18.813 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:18.814 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f15b40b5600 msgr2=0x7f15b40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:18.814 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f15b40b5600 0x7f15b40d5ab0 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15d4004750 tx=0x7f15d4009260 comp rx=0 tx=0).stop 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0122ad0 msgr2=0x7f15e0122f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0122ad0 0x7f15e0122f70 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15d00052a0 tx=0x7f15d00052d0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 shutdown_connections 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f15b40b5600 0x7f15b40d5ab0 unknown :-1 s=CLOSED pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f15e0122ad0 0x7f15e0122f70 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15e0115410 0x7f15e011d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 --2- 10.20.193.70:0/832560900 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f15e010f200 0x7f15e011d1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 >> 10.20.193.70:0/832560900 conn(0x7f15e00ecb00 msgr2=0x7f15e010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 shutdown_connections 2026-02-13T03:49:18.815 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:18.812+0000 7f15e57036c0 1 -- 10.20.193.70:0/832560900 wait complete. 2026-02-13T03:49:19.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:19 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/832560900' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:19.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:19 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/832560900' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:19.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:19 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/832560900' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:20.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:20 trial070 ceph-mon[24757]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:20.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:20 trial177 ceph-mon[27082]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:20.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:20 trial127 ceph-mon[26439]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:21.854 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:21.971 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:22.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.085+0000 7f792dd686c0 1 -- 10.20.193.70:0/2969718673 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f792810f230 msgr2=0x7f792810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:22.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.085+0000 7f792dd686c0 1 --2- 10.20.193.70:0/2969718673 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f792810f230 0x7f792810f600 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=5340544369364611957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79140099a0 tx=0x7f791402ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:22.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.085+0000 7f792dd686c0 1 -- 10.20.193.70:0/2969718673 shutdown_connections 2026-02-13T03:49:22.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.085+0000 7f792dd686c0 1 --2- 10.20.193.70:0/2969718673 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7928115440 0x7f7928175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.085+0000 7f792dd686c0 1 --2- 10.20.193.70:0/2969718673 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f792810fc20 0x7f7928114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.085+0000 7f792dd686c0 1 --2- 10.20.193.70:0/2969718673 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f792810f230 0x7f792810f600 unknown :-1 s=CLOSED pgs=449 gs=1 cs=0 l=1 c_cookie=5340544369364611957 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.085+0000 7f792dd686c0 1 -- 10.20.193.70:0/2969718673 >> 10.20.193.70:0/2969718673 conn(0x7f79280ecb30 msgr2=0x7f792810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.085+0000 7f792dd686c0 1 -- 10.20.193.70:0/2969718673 shutdown_connections 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.085+0000 7f792dd686c0 1 -- 10.20.193.70:0/2969718673 wait complete. 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f792dd686c0 1 Processor -- start 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f792dd686c0 1 -- start start 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f792dd686c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f792810f230 0x7f792811d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f792dd686c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7928115440 0x7f792811d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f792dd686c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7928122c80 0x7f7928123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f792dd686c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7928123690 con 0x7f7928122c80 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f792dd686c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f7928123800 con 0x7f792810f230 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f792dd686c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79281239c0 con 0x7f7928115440 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7927fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7928122c80 0x7f7928123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:22.088 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7927fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7928122c80 0x7f7928123120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:54186/0 (socket says 10.20.193.70:54186) 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7927fff6c0 1 -- 10.20.193.70:0/348530181 learned_addr learned my addr 10.20.193.70:0/348530181 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f79277fe6c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f792810f230 0x7f792811d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7926ffd6c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7928115440 0x7f792811d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7927fff6c0 1 -- 10.20.193.70:0/348530181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7928115440 msgr2=0x7f792811d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7927fff6c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7928115440 0x7f792811d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7927fff6c0 1 -- 10.20.193.70:0/348530181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f792810f230 msgr2=0x7f792811d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7927fff6c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f792810f230 0x7f792811d380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7927fff6c0 1 -- 10.20.193.70:0/348530181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7914009590 con 0x7f7928122c80 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f79277fe6c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f792810f230 0x7f792811d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7927fff6c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7928122c80 0x7f7928123120 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f791c006ea0 tx=0x7f791c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7924ff96c0 1 -- 10.20.193.70:0/348530181 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f791c003a30 con 0x7f7928122c80 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7924ff96c0 1 -- 10.20.193.70:0/348530181 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f791c0054f0 con 0x7f7928122c80 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7928163e70 con 0x7f7928122c80 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.086+0000 7f7924ff96c0 1 -- 10.20.193.70:0/348530181 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f791c00dcd0 con 0x7f7928122c80 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.087+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7928164300 con 0x7f7928122c80 2026-02-13T03:49:22.089 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.087+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7928110500 con 0x7f7928122c80 2026-02-13T03:49:22.090 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.088+0000 7f7924ff96c0 1 -- 10.20.193.70:0/348530181 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f791c005030 con 0x7f7928122c80 2026-02-13T03:49:22.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.089+0000 7f7924ff96c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78fc0b5600 0x7f78fc0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:22.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.089+0000 7f79277fe6c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78fc0b5600 0x7f78fc0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:22.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.089+0000 7f7924ff96c0 1 -- 10.20.193.70:0/348530181 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f791c0e4b10 con 0x7f7928122c80 2026-02-13T03:49:22.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.090+0000 7f7924ff96c0 1 -- 10.20.193.70:0/348530181 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f791c0a75d0 con 0x7f7928122c80 2026-02-13T03:49:22.091 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.090+0000 7f79277fe6c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78fc0b5600 0x7f78fc0d5ab0 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7914005b40 tx=0x7f7914005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:22.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.207+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f792810f600 con 0x7f7928122c80 2026-02-13T03:49:22.209 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.207+0000 7f7924ff96c0 1 -- 10.20.193.70:0/348530181 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f791c0ab030 con 0x7f7928122c80 2026-02-13T03:49:22.209 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:22.209 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:22.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78fc0b5600 msgr2=0x7f78fc0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:22.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78fc0b5600 0x7f78fc0d5ab0 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7914005b40 tx=0x7f7914005c00 comp rx=0 tx=0).stop 2026-02-13T03:49:22.210 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7928122c80 msgr2=0x7f7928123120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:22.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7928122c80 0x7f7928123120 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f791c006ea0 tx=0x7f791c00cca0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 shutdown_connections 2026-02-13T03:49:22.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f78fc0b5600 0x7f78fc0d5ab0 unknown :-1 s=CLOSED pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f7928122c80 0x7f7928123120 unknown :-1 s=CLOSED pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7928115440 0x7f792811d8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 --2- 10.20.193.70:0/348530181 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f792810f230 0x7f792811d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:22.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 >> 10.20.193.70:0/348530181 conn(0x7f79280ecb30 msgr2=0x7f792810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:22.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 shutdown_connections 2026-02-13T03:49:22.211 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:22.209+0000 7f792dd686c0 1 -- 10.20.193.70:0/348530181 wait complete. 2026-02-13T03:49:22.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:22 trial070 ceph-mon[24757]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:22.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:22 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/348530181' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:22.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:22 trial177 ceph-mon[27082]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:22.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:22 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/348530181' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:22.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:22 trial127 ceph-mon[26439]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:22.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:22 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/348530181' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:24.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:24 trial070 ceph-mon[24757]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:24.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:24 trial177 ceph-mon[27082]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:24.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:24 trial127 ceph-mon[26439]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:25.254 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:25.372 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:25.493 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.489+0000 7fe4b53406c0 1 -- 10.20.193.70:0/3922988822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010fbf0 msgr2=0x7fe4b0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.489+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/3922988822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010fbf0 0x7fe4b0114c30 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=8419215398637008565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4980099a0 tx=0x7fe49802ed50 comp rx=0 tx=0).stop 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.489+0000 7fe4b53406c0 1 -- 10.20.193.70:0/3922988822 shutdown_connections 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.489+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/3922988822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4b0115410 0x7fe4b0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.489+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/3922988822 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010fbf0 0x7fe4b0114c30 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=8419215398637008565 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/3922988822 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4b010f200 0x7fe4b010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 -- 10.20.193.70:0/3922988822 >> 10.20.193.70:0/3922988822 conn(0x7fe4b00ecb00 msgr2=0x7fe4b010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 -- 10.20.193.70:0/3922988822 shutdown_connections 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 -- 10.20.193.70:0/3922988822 wait complete. 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 Processor -- start 2026-02-13T03:49:25.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 -- start start 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010f200 0x7fe4b00f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4b0115410 0x7fe4b0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4b00f5310 0x7fe4b00fa5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b00f5970 con 0x7fe4b010f200 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b00fab20 con 0x7fe4b0115410 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b00face0 con 0x7fe4b00f5310 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4aeffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010f200 0x7fe4b00f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4aeffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010f200 0x7fe4b00f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:54200/0 (socket says 10.20.193.70:54200) 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4aeffd6c0 1 -- 10.20.193.70:0/2071658396 learned_addr learned my addr 10.20.193.70:0/2071658396 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4af7fe6c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4b00f5310 0x7fe4b00fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4aeffd6c0 1 -- 10.20.193.70:0/2071658396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4b00f5310 msgr2=0x7fe4b00fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:25.495 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4aeffd6c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4b00f5310 0x7fe4b00fa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4aeffd6c0 1 -- 10.20.193.70:0/2071658396 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4b0115410 msgr2=0x7fe4b0175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4aeffd6c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4b0115410 0x7fe4b0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4aeffd6c0 1 -- 10.20.193.70:0/2071658396 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe498009590 con 0x7fe4b010f200 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4aeffd6c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010f200 0x7fe4b00f4ce0 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4a400b6c0 tx=0x7fe4a400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe48ffff6c0 1 -- 10.20.193.70:0/2071658396 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4a4004560 con 0x7fe4b010f200 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe48ffff6c0 1 -- 10.20.193.70:0/2071658396 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe4a4009030 con 0x7fe4b010f200 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b00faf60 con 0x7fe4b010f200 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe48ffff6c0 1 -- 10.20.193.70:0/2071658396 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4a400cd90 con 0x7fe4b010f200 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.490+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b00fb440 con 0x7fe4b010f200 2026-02-13T03:49:25.496 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.491+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b01104d0 con 0x7fe4b010f200 2026-02-13T03:49:25.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.492+0000 7fe48ffff6c0 1 -- 10.20.193.70:0/2071658396 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fe4a40026b0 con 0x7fe4b010f200 2026-02-13T03:49:25.497 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.493+0000 7fe48ffff6c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe4840b5600 0x7fe4840d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:25.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.493+0000 7fe4ae7fc6c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe4840b5600 0x7fe4840d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:25.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.493+0000 7fe48ffff6c0 1 -- 10.20.193.70:0/2071658396 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fe4a40e3970 con 0x7fe4b010f200 2026-02-13T03:49:25.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.493+0000 7fe48ffff6c0 1 -- 10.20.193.70:0/2071658396 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe4a40e3df0 con 0x7fe4b010f200 2026-02-13T03:49:25.498 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.493+0000 7fe4ae7fc6c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe4840b5600 0x7fe4840d5ab0 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe498005b40 tx=0x7fe4980091a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:25.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.612+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe4b010f5d0 con 0x7fe4b010f200 2026-02-13T03:49:25.614 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.612+0000 7fe48ffff6c0 1 -- 10.20.193.70:0/2071658396 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe4a40a63f0 con 0x7fe4b010f200 2026-02-13T03:49:25.614 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:25.614 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:25.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe4840b5600 msgr2=0x7fe4840d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:25.615 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe4840b5600 0x7fe4840d5ab0 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe498005b40 tx=0x7fe4980091a0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010f200 msgr2=0x7fe4b00f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010f200 0x7fe4b00f4ce0 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4a400b6c0 tx=0x7fe4a400bb90 comp rx=0 tx=0).stop 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 shutdown_connections 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fe4840b5600 0x7fe4840d5ab0 unknown :-1 s=CLOSED pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4b00f5310 0x7fe4b00fa5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fe4b0115410 0x7fe4b0175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 --2- 10.20.193.70:0/2071658396 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fe4b010f200 0x7fe4b00f4ce0 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 >> 10.20.193.70:0/2071658396 conn(0x7fe4b00ecb00 msgr2=0x7fe4b010d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 shutdown_connections 2026-02-13T03:49:25.616 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:25.613+0000 7fe4b53406c0 1 -- 10.20.193.70:0/2071658396 wait complete. 2026-02-13T03:49:26.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:26 trial070 ceph-mon[24757]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:26.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:26 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2071658396' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:26.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:26 trial177 ceph-mon[27082]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:26.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:26 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2071658396' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:26.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:26 trial127 ceph-mon[26439]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:26.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:26 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2071658396' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:27.427 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:49:27.427 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:49:27.428 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:49:27.428 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:49:27.428 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:49:27.428 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:49:27.428 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:49:27.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:49:27.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:49:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:49:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:49:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:49:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:49:27.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:49:27.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:49:27.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:49:27.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:49:27.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:49:27.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:49:27.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:49:27.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:49:28.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:28 trial070 ceph-mon[24757]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:28.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:28 trial070 ceph-mon[24757]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 981 B/s rd, 1 op/s 2026-02-13T03:49:28.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:28 trial070 ceph-mon[24757]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:49:28.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:28 trial070 ceph-mon[24757]: Cluster is now healthy 2026-02-13T03:49:28.659 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:28.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:28 trial177 ceph-mon[27082]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:28.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:28 trial177 ceph-mon[27082]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 981 B/s rd, 1 op/s 2026-02-13T03:49:28.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:28 trial177 ceph-mon[27082]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:49:28.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:28 trial177 ceph-mon[27082]: Cluster is now healthy 2026-02-13T03:49:28.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:28 trial127 ceph-mon[26439]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:28.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:28 trial127 ceph-mon[26439]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 981 B/s rd, 1 op/s 2026-02-13T03:49:28.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:28 trial127 ceph-mon[26439]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:49:28.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:28 trial127 ceph-mon[26439]: Cluster is now healthy 2026-02-13T03:49:28.776 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:28.895 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/1966347509 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb8810f200 msgr2=0x7fdb8810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:28.895 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/1966347509 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb8810f200 0x7fdb8810f5d0 secure :-1 s=READY pgs=453 gs=1 cs=0 l=1 c_cookie=18111166210343994933 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb740099a0 tx=0x7fdb7402ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:28.895 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/1966347509 shutdown_connections 2026-02-13T03:49:28.895 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/1966347509 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88115410 0x7fdb88175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:28.895 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/1966347509 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb8810fbf0 0x7fdb88114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:28.895 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/1966347509 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb8810f200 0x7fdb8810f5d0 unknown :-1 s=CLOSED pgs=453 gs=1 cs=0 l=1 c_cookie=18111166210343994933 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:28.895 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/1966347509 >> 10.20.193.70:0/1966347509 conn(0x7fdb880ecb00 msgr2=0x7fdb8810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:28.895 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/1966347509 shutdown_connections 2026-02-13T03:49:28.895 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/1966347509 wait complete. 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 Processor -- start 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 -- start start 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb8810f200 0x7fdb8811d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88115410 0x7fdb8811d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb88122c30 0x7fdb881230d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88123610 con 0x7fdb88122c30 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88123780 con 0x7fdb8810f200 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb8e0936c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88123940 con 0x7fdb88115410 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb87fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb88122c30 0x7fdb881230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb87fff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb88122c30 0x7fdb881230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:41080/0 (socket says 10.20.193.70:41080) 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb87fff6c0 1 -- 10.20.193.70:0/3332280591 learned_addr learned my addr 10.20.193.70:0/3332280591 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb86ffd6c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88115410 0x7fdb8811d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.893+0000 7fdb877fe6c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb8810f200 0x7fdb8811d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb87fff6c0 1 -- 10.20.193.70:0/3332280591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88115410 msgr2=0x7fdb8811d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb87fff6c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88115410 0x7fdb8811d870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb87fff6c0 1 -- 10.20.193.70:0/3332280591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb8810f200 msgr2=0x7fdb8811d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb87fff6c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb8810f200 0x7fdb8811d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb87fff6c0 1 -- 10.20.193.70:0/3332280591 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb74009590 con 0x7fdb88122c30 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb87fff6c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb88122c30 0x7fdb881230d0 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb7c00c6c0 tx=0x7fdb7c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb84ff96c0 1 -- 10.20.193.70:0/3332280591 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb7c003c40 con 0x7fdb88122c30 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb84ff96c0 1 -- 10.20.193.70:0/3332280591 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdb7c00a030 con 0x7fdb88122c30 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb88163dc0 con 0x7fdb88122c30 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb84ff96c0 1 -- 10.20.193.70:0/3332280591 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb7c00db70 con 0x7fdb88122c30 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb88164250 con 0x7fdb88122c30 2026-02-13T03:49:28.896 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.894+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb881104d0 con 0x7fdb88122c30 2026-02-13T03:49:28.897 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.896+0000 7fdb84ff96c0 1 -- 10.20.193.70:0/3332280591 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fdb7c00dd20 con 0x7fdb88122c30 2026-02-13T03:49:28.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.897+0000 7fdb84ff96c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdb5c0b5600 0x7fdb5c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:28.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.897+0000 7fdb877fe6c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdb5c0b5600 0x7fdb5c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:28.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.897+0000 7fdb84ff96c0 1 -- 10.20.193.70:0/3332280591 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fdb7c0e48c0 con 0x7fdb88122c30 2026-02-13T03:49:28.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.897+0000 7fdb84ff96c0 1 -- 10.20.193.70:0/3332280591 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdb7c0aa350 con 0x7fdb88122c30 2026-02-13T03:49:28.898 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:28.897+0000 7fdb877fe6c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdb5c0b5600 0x7fdb5c0d5ab0 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb74031fd0 tx=0x7fdb740023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:29.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.013+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdb8810f5d0 con 0x7fdb88122c30 2026-02-13T03:49:29.015 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.013+0000 7fdb84ff96c0 1 -- 10.20.193.70:0/3332280591 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdb7c0aa530 con 0x7fdb88122c30 2026-02-13T03:49:29.015 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:29.015 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdb5c0b5600 msgr2=0x7fdb5c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdb5c0b5600 0x7fdb5c0d5ab0 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb74031fd0 tx=0x7fdb740023a0 comp rx=0 tx=0).stop 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb88122c30 msgr2=0x7fdb881230d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb88122c30 0x7fdb881230d0 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb7c00c6c0 tx=0x7fdb7c00cb90 comp rx=0 tx=0).stop 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 shutdown_connections 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fdb5c0b5600 0x7fdb5c0d5ab0 unknown :-1 s=CLOSED pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fdb88122c30 0x7fdb881230d0 unknown :-1 s=CLOSED pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88115410 0x7fdb8811d870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 --2- 10.20.193.70:0/3332280591 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fdb8810f200 0x7fdb8811d330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 >> 10.20.193.70:0/3332280591 conn(0x7fdb880ecb00 msgr2=0x7fdb8810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 shutdown_connections 2026-02-13T03:49:29.016 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:29.014+0000 7fdb8e0936c0 1 -- 10.20.193.70:0/3332280591 wait complete. 2026-02-13T03:49:29.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:29 trial070 ceph-mon[24757]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:29 trial070 ceph-mon[24757]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:49:29.298 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:29 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3332280591' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:29.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:29 trial177 ceph-mon[27082]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:29.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:29 trial177 ceph-mon[27082]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:49:29.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:29 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3332280591' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:29.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:29 trial127 ceph-mon[26439]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:29.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:29 trial127 ceph-mon[26439]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:49:29.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:29 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3332280591' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:31.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:31 trial070 ceph-mon[24757]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:31.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:31 trial177 ceph-mon[27082]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:31.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:31 trial127 ceph-mon[26439]: pgmap v316: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:32.076 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:32.195 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:32.308 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1103406125 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e810f230 msgr2=0x7f65e810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:32.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1103406125 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e810f230 0x7f65e810f600 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=1105949715214998901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65d80099a0 tx=0x7f65d802ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:32.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1103406125 shutdown_connections 2026-02-13T03:49:32.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1103406125 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f65e8115440 0x7f65e8175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1103406125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65e810fc20 0x7f65e8114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1103406125 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e810f230 0x7f65e810f600 unknown :-1 s=CLOSED pgs=455 gs=1 cs=0 l=1 c_cookie=1105949715214998901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1103406125 >> 10.20.193.70:0/1103406125 conn(0x7f65e80ecb30 msgr2=0x7f65e810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:32.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1103406125 shutdown_connections 2026-02-13T03:49:32.309 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1103406125 wait complete. 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.304+0000 7f65efb4c6c0 1 Processor -- start 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 -- start start 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f65e810f230 0x7f65e811d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65e8115440 0x7f65e811d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e8122c50 0x7f65e81230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65e8123660 con 0x7f65e8122c50 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f65e81237d0 con 0x7f65e810f230 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f65e8123990 con 0x7f65e8115440 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ee0c26c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e8122c50 0x7f65e81230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ee0c26c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e8122c50 0x7f65e81230f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:41096/0 (socket says 10.20.193.70:41096) 2026-02-13T03:49:32.310 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ee0c26c0 1 -- 10.20.193.70:0/1701129623 learned_addr learned my addr 10.20.193.70:0/1701129623 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ed0c06c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65e8115440 0x7f65e811d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ed8c16c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f65e810f230 0x7f65e811d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ee0c26c0 1 -- 10.20.193.70:0/1701129623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65e8115440 msgr2=0x7f65e811d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ee0c26c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65e8115440 0x7f65e811d890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ee0c26c0 1 -- 10.20.193.70:0/1701129623 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f65e810f230 msgr2=0x7f65e811d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ee0c26c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f65e810f230 0x7f65e811d350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ee0c26c0 1 -- 10.20.193.70:0/1701129623 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d8009590 con 0x7f65e8122c50 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ed8c16c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f65e810f230 0x7f65e811d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65ee0c26c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e8122c50 0x7f65e81230f0 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65e4006ea0 tx=0x7f65e400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65d6ffd6c0 1 -- 10.20.193.70:0/1701129623 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65e4003a30 con 0x7f65e8122c50 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65d6ffd6c0 1 -- 10.20.193.70:0/1701129623 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f65e40054f0 con 0x7f65e8122c50 2026-02-13T03:49:32.311 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e8163e40 con 0x7f65e8122c50 2026-02-13T03:49:32.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65d6ffd6c0 1 -- 10.20.193.70:0/1701129623 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65e400dcd0 con 0x7f65e8122c50 2026-02-13T03:49:32.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e8164320 con 0x7f65e8122c50 2026-02-13T03:49:32.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.305+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e8110500 con 0x7f65e8122c50 2026-02-13T03:49:32.312 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.307+0000 7f65d6ffd6c0 1 -- 10.20.193.70:0/1701129623 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f65e4005030 con 0x7f65e8122c50 2026-02-13T03:49:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.307+0000 7f65d6ffd6c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f65c40b5680 0x7f65c40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.307+0000 7f65d6ffd6c0 1 -- 10.20.193.70:0/1701129623 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f65e40e4b90 con 0x7f65e8122c50 2026-02-13T03:49:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.307+0000 7f65ed8c16c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f65c40b5680 0x7f65c40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.308+0000 7f65ed8c16c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f65c40b5680 0x7f65c40d5b30 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65d80098c0 tx=0x7f65d8005ae0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:32.313 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.308+0000 7f65d6ffd6c0 1 -- 10.20.193.70:0/1701129623 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f65e40a7610 con 0x7f65e8122c50 2026-02-13T03:49:32.433 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.432+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f65e810f600 con 0x7f65e8122c50 2026-02-13T03:49:32.434 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:32.434 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:32.435 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.432+0000 7f65d6ffd6c0 1 -- 10.20.193.70:0/1701129623 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f65e400de60 con 0x7f65e8122c50 2026-02-13T03:49:32.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f65c40b5680 msgr2=0x7f65c40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:32.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f65c40b5680 0x7f65c40d5b30 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65d80098c0 tx=0x7f65d8005ae0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e8122c50 msgr2=0x7f65e81230f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:32.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e8122c50 0x7f65e81230f0 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65e4006ea0 tx=0x7f65e400cca0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 shutdown_connections 2026-02-13T03:49:32.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f65c40b5680 0x7f65c40d5b30 unknown :-1 s=CLOSED pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f65e8122c50 0x7f65e81230f0 unknown :-1 s=CLOSED pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65e8115440 0x7f65e811d890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.437 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 --2- 10.20.193.70:0/1701129623 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f65e810f230 0x7f65e811d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:32.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 >> 10.20.193.70:0/1701129623 conn(0x7f65e80ecb30 msgr2=0x7f65e810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:32.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 shutdown_connections 2026-02-13T03:49:32.438 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:32.434+0000 7f65efb4c6c0 1 -- 10.20.193.70:0/1701129623 wait complete. 2026-02-13T03:49:33.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:33 trial070 ceph-mon[24757]: pgmap v317: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:33.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:33 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1701129623' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:33.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:33 trial177 ceph-mon[27082]: pgmap v317: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:33.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:33 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1701129623' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:33.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:33 trial127 ceph-mon[26439]: pgmap v317: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:33.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:33 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1701129623' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:35.484 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:35.507 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:35 trial070 ceph-mon[24757]: pgmap v318: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 566 B/s rd, 1 op/s 2026-02-13T03:49:35.606 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:35.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:35 trial177 ceph-mon[27082]: pgmap v318: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 566 B/s rd, 1 op/s 2026-02-13T03:49:35.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:35 trial127 ceph-mon[26439]: pgmap v318: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 566 B/s rd, 1 op/s 2026-02-13T03:49:35.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.721+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/3532770338 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410f200 msgr2=0x7fde4410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:35.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.721+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/3532770338 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410f200 0x7fde4410f5d0 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=16913082961798433365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde340099a0 tx=0x7fde3402ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:35.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.721+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/3532770338 shutdown_connections 2026-02-13T03:49:35.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.721+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/3532770338 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde44115410 0x7fde44175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:35.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.721+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/3532770338 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410fbf0 0x7fde44114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:35.723 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.721+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/3532770338 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde4410f200 0x7fde4410f5d0 unknown :-1 s=CLOSED pgs=457 gs=1 cs=0 l=1 c_cookie=16913082961798433365 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.721+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/3532770338 >> 10.20.193.70:0/3532770338 conn(0x7fde440ecb00 msgr2=0x7fde4410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.721+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/3532770338 shutdown_connections 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.721+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/3532770338 wait complete. 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 Processor -- start 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 -- start start 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410f200 0x7fde4411d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde44115410 0x7fde4411d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde44122c30 0x7fde441230d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde44123640 con 0x7fde44122c30 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fde441237b0 con 0x7fde4410f200 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fde44123970 con 0x7fde44115410 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a8a16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde44122c30 0x7fde441230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a8a16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde44122c30 0x7fde441230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:41112/0 (socket says 10.20.193.70:41112) 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a8a16c0 1 -- 10.20.193.70:0/4002135367 learned_addr learned my addr 10.20.193.70:0/4002135367 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a0a06c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410f200 0x7fde4411d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a8a16c0 1 -- 10.20.193.70:0/4002135367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde44115410 msgr2=0x7fde4411d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4989f6c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde44115410 0x7fde4411d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a8a16c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde44115410 0x7fde4411d870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a8a16c0 1 -- 10.20.193.70:0/4002135367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410f200 msgr2=0x7fde4411d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:35.724 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a8a16c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410f200 0x7fde4411d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:35.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a8a16c0 1 -- 10.20.193.70:0/4002135367 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde34009590 con 0x7fde44122c30 2026-02-13T03:49:35.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4a8a16c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde44122c30 0x7fde441230d0 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde40006ea0 tx=0x7fde4000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:35.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde2b7fe6c0 1 -- 10.20.193.70:0/4002135367 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde40003c40 con 0x7fde44122c30 2026-02-13T03:49:35.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde44163e20 con 0x7fde44122c30 2026-02-13T03:49:35.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde2b7fe6c0 1 -- 10.20.193.70:0/4002135367 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fde40003da0 con 0x7fde44122c30 2026-02-13T03:49:35.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde2b7fe6c0 1 -- 10.20.193.70:0/4002135367 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde400081c0 con 0x7fde44122c30 2026-02-13T03:49:35.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.722+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde441642b0 con 0x7fde44122c30 2026-02-13T03:49:35.725 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.723+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde441104d0 con 0x7fde44122c30 2026-02-13T03:49:35.726 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.724+0000 7fde2b7fe6c0 1 -- 10.20.193.70:0/4002135367 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fde40005860 con 0x7fde44122c30 2026-02-13T03:49:35.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.725+0000 7fde2b7fe6c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde200b5600 0x7fde200d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:35.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.725+0000 7fde2b7fe6c0 1 -- 10.20.193.70:0/4002135367 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fde400e4b90 con 0x7fde44122c30 2026-02-13T03:49:35.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.725+0000 7fde4a0a06c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde200b5600 0x7fde200d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:35.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.725+0000 7fde4a0a06c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde200b5600 0x7fde200d5ab0 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde340023e0 tx=0x7fde34005c60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:35.727 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.726+0000 7fde2b7fe6c0 1 -- 10.20.193.70:0/4002135367 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fde400a7650 con 0x7fde44122c30 2026-02-13T03:49:35.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.845+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fde4411e480 con 0x7fde44122c30 2026-02-13T03:49:35.846 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.845+0000 7fde2b7fe6c0 1 -- 10.20.193.70:0/4002135367 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fde400aa800 con 0x7fde44122c30 2026-02-13T03:49:35.846 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:35.846 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:35.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde200b5600 msgr2=0x7fde200d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:35.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde200b5600 0x7fde200d5ab0 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde340023e0 tx=0x7fde34005c60 comp rx=0 tx=0).stop 2026-02-13T03:49:35.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde44122c30 msgr2=0x7fde441230d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:35.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde44122c30 0x7fde441230d0 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde40006ea0 tx=0x7fde4000ce50 comp rx=0 tx=0).stop 2026-02-13T03:49:35.847 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 shutdown_connections 2026-02-13T03:49:35.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fde200b5600 0x7fde200d5ab0 unknown :-1 s=CLOSED pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:35.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fde44122c30 0x7fde441230d0 unknown :-1 s=CLOSED pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:35.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde44115410 0x7fde4411d870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:35.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 --2- 10.20.193.70:0/4002135367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fde4410f200 0x7fde4411d330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:35.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 >> 10.20.193.70:0/4002135367 conn(0x7fde440ecb00 msgr2=0x7fde4410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:35.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 shutdown_connections 2026-02-13T03:49:35.848 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:35.846+0000 7fde4c32f6c0 1 -- 10.20.193.70:0/4002135367 wait complete. 2026-02-13T03:49:36.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:36 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4002135367' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:36.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:36 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4002135367' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:36.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:36 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4002135367' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:37.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:37 trial070 ceph-mon[24757]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:37.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:37 trial177 ceph-mon[27082]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:37.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:37 trial127 ceph-mon[26439]: pgmap v319: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:49:38.890 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:39.009 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1308978640 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c10f230 msgr2=0x7fd97c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1308978640 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c10f230 0x7fd97c10f600 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=303914319962192827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9680099a0 tx=0x7fd96802ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1308978640 shutdown_connections 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1308978640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd97c115440 0x7fd97c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1308978640 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd97c10fc20 0x7fd97c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1308978640 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c10f230 0x7fd97c10f600 unknown :-1 s=CLOSED pgs=459 gs=1 cs=0 l=1 c_cookie=303914319962192827 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1308978640 >> 10.20.193.70:0/1308978640 conn(0x7fd97c0ecb30 msgr2=0x7fd97c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1308978640 shutdown_connections 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1308978640 wait complete. 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 Processor -- start 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 -- start start 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd97c10f230 0x7fd97c11d270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c115440 0x7fd97c11d7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd97c122b70 0x7fd97c123010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c123580 con 0x7fd97c115440 2026-02-13T03:49:39.126 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c1236f0 con 0x7fd97c122b70 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd981bed6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c1238b0 con 0x7fd97c10f230 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97affd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c115440 0x7fd97c11d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97affd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c115440 0x7fd97c11d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:57618/0 (socket says 10.20.193.70:57618) 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97affd6c0 1 -- 10.20.193.70:0/1004084303 learned_addr learned my addr 10.20.193.70:0/1004084303 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97b7fe6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd97c10f230 0x7fd97c11d270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97affd6c0 1 -- 10.20.193.70:0/1004084303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd97c10f230 msgr2=0x7fd97c11d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97affd6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd97c10f230 0x7fd97c11d270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97affd6c0 1 -- 10.20.193.70:0/1004084303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd97c122b70 msgr2=0x7fd97c123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97affd6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd97c122b70 0x7fd97c123010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97affd6c0 1 -- 10.20.193.70:0/1004084303 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd968009590 con 0x7fd97c115440 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97b7fe6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd97c10f230 0x7fd97c11d270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd97affd6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c115440 0x7fd97c11d7b0 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd96c00b800 tx=0x7fd96c00bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.123+0000 7fd978ff96c0 1 -- 10.20.193.70:0/1004084303 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd96c004a80 con 0x7fd97c115440 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.124+0000 7fd978ff96c0 1 -- 10.20.193.70:0/1004084303 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd96c009070 con 0x7fd97c115440 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.124+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97c163d60 con 0x7fd97c115440 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.124+0000 7fd978ff96c0 1 -- 10.20.193.70:0/1004084303 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd96c00cdd0 con 0x7fd97c115440 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.124+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97c1641f0 con 0x7fd97c115440 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.124+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd97c110500 con 0x7fd97c115440 2026-02-13T03:49:39.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.125+0000 7fd978ff96c0 1 -- 10.20.193.70:0/1004084303 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fd96c004060 con 0x7fd97c115440 2026-02-13T03:49:39.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.126+0000 7fd978ff96c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd9500b5600 0x7fd9500d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:39.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.126+0000 7fd97b7fe6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd9500b5600 0x7fd9500d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:39.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.126+0000 7fd978ff96c0 1 -- 10.20.193.70:0/1004084303 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fd96c0e3ae0 con 0x7fd97c115440 2026-02-13T03:49:39.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.126+0000 7fd978ff96c0 1 -- 10.20.193.70:0/1004084303 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd96c0a9710 con 0x7fd97c115440 2026-02-13T03:49:39.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.127+0000 7fd97b7fe6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd9500b5600 0x7fd9500d5ab0 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd968009970 tx=0x7fd9680023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:39.247 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.245+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd97c10fc20 con 0x7fd97c115440 2026-02-13T03:49:39.248 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.245+0000 7fd978ff96c0 1 -- 10.20.193.70:0/1004084303 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd96c0a98f0 con 0x7fd97c115440 2026-02-13T03:49:39.248 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:39.248 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd9500b5600 msgr2=0x7fd9500d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd9500b5600 0x7fd9500d5ab0 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd968009970 tx=0x7fd9680023a0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c115440 msgr2=0x7fd97c11d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c115440 0x7fd97c11d7b0 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd96c00b800 tx=0x7fd96c00bcd0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 shutdown_connections 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd9500b5600 0x7fd9500d5ab0 unknown :-1 s=CLOSED pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd97c122b70 0x7fd97c123010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd97c115440 0x7fd97c11d7b0 unknown :-1 s=CLOSED pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 --2- 10.20.193.70:0/1004084303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd97c10f230 0x7fd97c11d270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:39.250 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 >> 10.20.193.70:0/1004084303 conn(0x7fd97c0ecb30 msgr2=0x7fd97c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:39.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 shutdown_connections 2026-02-13T03:49:39.251 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:39.247+0000 7fd981bed6c0 1 -- 10.20.193.70:0/1004084303 wait complete. 2026-02-13T03:49:39.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:39 trial070 ceph-mon[24757]: pgmap v320: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 964 B/s rd, 1 op/s 2026-02-13T03:49:39.548 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:39 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1004084303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:39.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:39 trial177 ceph-mon[27082]: pgmap v320: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 964 B/s rd, 1 op/s 2026-02-13T03:49:39.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:39 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1004084303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:39.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:39 trial127 ceph-mon[26439]: pgmap v320: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 964 B/s rd, 1 op/s 2026-02-13T03:49:39.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:39 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1004084303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:41.525 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:41 trial127 ceph-mon[26439]: pgmap v321: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:41.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:41 trial070 ceph-mon[24757]: pgmap v321: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:41.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:41 trial177 ceph-mon[27082]: pgmap v321: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:42.292 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:42.410 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:42.528 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/839957692 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 msgr2=0x7fa1f8175ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:42.528 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/839957692 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 0x7fa1f8175ba0 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=17417308128884548052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1f400aa40 tx=0x7fa1f402fde0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.528 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/839957692 shutdown_connections 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/839957692 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 0x7fa1f8175ba0 unknown :-1 s=CLOSED pgs=461 gs=1 cs=0 l=1 c_cookie=17417308128884548052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/839957692 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1f810c3a0 0x7fa1f8155280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/839957692 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1f810ba90 0x7fa1f810be60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/839957692 >> 10.20.193.70:0/839957692 conn(0x7fa1f80e9770 msgr2=0x7fa1f8109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/839957692 shutdown_connections 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/839957692 wait complete. 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 Processor -- start 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.524+0000 7fa1ff1406c0 1 -- start start 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1ff1406c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1f810ba90 0x7fa1f8160550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1ff1406c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1f810c3a0 0x7fa1f8160a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:42.529 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1ff1406c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 0x7fa1f8165e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1ff1406c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81664a0 con 0x7fa1f81557c0 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1ff1406c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f8166610 con 0x7fa1f810c3a0 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1ff1406c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81667d0 con 0x7fa1f810ba90 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fd6b66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 0x7fa1f8165e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fd6b66c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 0x7fa1f8165e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:57638/0 (socket says 10.20.193.70:57638) 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fd6b66c0 1 -- 10.20.193.70:0/2964753762 learned_addr learned my addr 10.20.193.70:0/2964753762 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1effff6c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1f810c3a0 0x7fa1f8160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fceb56c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1f810ba90 0x7fa1f8160550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fd6b66c0 1 -- 10.20.193.70:0/2964753762 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1f810ba90 msgr2=0x7fa1f8160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fd6b66c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1f810ba90 0x7fa1f8160550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fd6b66c0 1 -- 10.20.193.70:0/2964753762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1f810c3a0 msgr2=0x7fa1f8160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:42.530 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fd6b66c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1f810c3a0 0x7fa1f8160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fd6b66c0 1 -- 10.20.193.70:0/2964753762 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f400a660 con 0x7fa1f81557c0 2026-02-13T03:49:42.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1fd6b66c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 0x7fa1f8165e50 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1f400a390 tx=0x7fa1f4005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:42.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1edffb6c0 1 -- 10.20.193.70:0/2964753762 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1f4003a30 con 0x7fa1f81557c0 2026-02-13T03:49:42.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1edffb6c0 1 -- 10.20.193.70:0/2964753762 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa1f4003b90 con 0x7fa1f81557c0 2026-02-13T03:49:42.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f8166a50 con 0x7fa1f81557c0 2026-02-13T03:49:42.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1edffb6c0 1 -- 10.20.193.70:0/2964753762 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1f40382f0 con 0x7fa1f81557c0 2026-02-13T03:49:42.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f8166cd0 con 0x7fa1f81557c0 2026-02-13T03:49:42.531 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.525+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f805fb30 con 0x7fa1f81557c0 2026-02-13T03:49:42.532 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.527+0000 7fa1edffb6c0 1 -- 10.20.193.70:0/2964753762 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fa1f4008260 con 0x7fa1f81557c0 2026-02-13T03:49:42.532 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.527+0000 7fa1edffb6c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1d40b5600 0x7fa1d40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:42.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.528+0000 7fa1fceb56c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1d40b5600 0x7fa1d40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:42.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.528+0000 7fa1edffb6c0 1 -- 10.20.193.70:0/2964753762 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fa1f4109000 con 0x7fa1f81557c0 2026-02-13T03:49:42.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.528+0000 7fa1edffb6c0 1 -- 10.20.193.70:0/2964753762 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa1f40cec70 con 0x7fa1f81557c0 2026-02-13T03:49:42.533 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.528+0000 7fa1fceb56c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1d40b5600 0x7fa1d40d5ab0 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1e8005980 tx=0x7fa1e8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:42.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.645+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa1f810be60 con 0x7fa1f81557c0 2026-02-13T03:49:42.647 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.645+0000 7fa1edffb6c0 1 -- 10.20.193.70:0/2964753762 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa1f40cee50 con 0x7fa1f81557c0 2026-02-13T03:49:42.647 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:42.647 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:42.648 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1d40b5600 msgr2=0x7fa1d40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1d40b5600 0x7fa1d40d5ab0 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1e8005980 tx=0x7fa1e8005910 comp rx=0 tx=0).stop 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 msgr2=0x7fa1f8165e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 0x7fa1f8165e50 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1f400a390 tx=0x7fa1f4005530 comp rx=0 tx=0).stop 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 shutdown_connections 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa1d40b5600 0x7fa1d40d5ab0 unknown :-1 s=CLOSED pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa1f81557c0 0x7fa1f8165e50 unknown :-1 s=CLOSED pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa1f810c3a0 0x7fa1f8160a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 --2- 10.20.193.70:0/2964753762 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa1f810ba90 0x7fa1f8160550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 >> 10.20.193.70:0/2964753762 conn(0x7fa1f80e9770 msgr2=0x7fa1f8109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:42.649 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 shutdown_connections 2026-02-13T03:49:42.650 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:42.646+0000 7fa1ff1406c0 1 -- 10.20.193.70:0/2964753762 wait complete. 2026-02-13T03:49:43.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:43 trial070 ceph-mon[24757]: pgmap v322: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:43.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:43 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2964753762' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:43.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:43 trial177 ceph-mon[27082]: pgmap v322: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:43.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:43 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2964753762' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:43.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:43 trial127 ceph-mon[26439]: pgmap v322: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:43.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:43 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2964753762' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:45.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:45 trial070 ceph-mon[24757]: pgmap v323: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:45.689 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:45.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:45 trial177 ceph-mon[27082]: pgmap v323: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:45.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:45 trial127 ceph-mon[26439]: pgmap v323: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:45.807 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:45.926 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.922+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/2871288060 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8057c40 msgr2=0x7fa7a8058010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:45.926 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.922+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/2871288060 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8057c40 0x7fa7a8058010 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=18058935939135679462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa798009970 tx=0x7fa79802ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.922+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/2871288060 shutdown_connections 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.922+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/2871288060 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7a815e0c0 0x7fa7a817e4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.922+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/2871288060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7a8058550 0x7fa7a815db80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.922+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/2871288060 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8057c40 0x7fa7a8058010 unknown :-1 s=CLOSED pgs=463 gs=1 cs=0 l=1 c_cookie=18058935939135679462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.922+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/2871288060 >> 10.20.193.70:0/2871288060 conn(0x7fa7a805e060 msgr2=0x7fa7a805e460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.922+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/2871288060 shutdown_connections 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.922+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/2871288060 wait complete. 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 Processor -- start 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 -- start start 2026-02-13T03:49:45.927 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7a8057c40 0x7fa7a80ff350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8058550 0x7fa7a80ff890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7a815e0c0 0x7fa7a8104c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a81052a0 con 0x7fa7a8058550 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8105410 con 0x7fa7a8057c40 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a81055d0 con 0x7fa7a815e0c0 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7acc616c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8058550 0x7fa7a80ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7acc616c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8058550 0x7fa7a80ff890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:57646/0 (socket says 10.20.193.70:57646) 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7acc616c0 1 -- 10.20.193.70:0/1291425245 learned_addr learned my addr 10.20.193.70:0/1291425245 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7ad4626c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7a8057c40 0x7fa7a80ff350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7adc636c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7a815e0c0 0x7fa7a8104c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7acc616c0 1 -- 10.20.193.70:0/1291425245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7a815e0c0 msgr2=0x7fa7a8104c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:45.928 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7acc616c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7a815e0c0 0x7fa7a8104c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7acc616c0 1 -- 10.20.193.70:0/1291425245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7a8057c40 msgr2=0x7fa7a80ff350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7acc616c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7a8057c40 0x7fa7a80ff350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7acc616c0 1 -- 10.20.193.70:0/1291425245 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa798009590 con 0x7fa7a8058550 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7ad4626c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7a8057c40 0x7fa7a80ff350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7adc636c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7a815e0c0 0x7fa7a8104c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7acc616c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8058550 0x7fa7a80ff890 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa79c005dc0 tx=0x7fa79c00bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7967fc6c0 1 -- 10.20.193.70:0/1291425245 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa79c004250 con 0x7fa7a8058550 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7967fc6c0 1 -- 10.20.193.70:0/1291425245 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa79c009070 con 0x7fa7a8058550 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a81058b0 con 0x7fa7a8058550 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7967fc6c0 1 -- 10.20.193.70:0/1291425245 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa79c00ce10 con 0x7fa7a8058550 2026-02-13T03:49:45.929 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.923+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a8159cf0 con 0x7fa7a8058550 2026-02-13T03:49:45.930 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.924+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a8105ad0 con 0x7fa7a8058550 2026-02-13T03:49:45.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.925+0000 7fa7967fc6c0 1 -- 10.20.193.70:0/1291425245 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fa79c0028c0 con 0x7fa7a8058550 2026-02-13T03:49:45.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.926+0000 7fa7967fc6c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa7840b5600 0x7fa7840d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:45.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.926+0000 7fa7967fc6c0 1 -- 10.20.193.70:0/1291425245 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fa79c0e39f0 con 0x7fa7a8058550 2026-02-13T03:49:45.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.926+0000 7fa7ad4626c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa7840b5600 0x7fa7840d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:45.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.926+0000 7fa7967fc6c0 1 -- 10.20.193.70:0/1291425245 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa79c0a64b0 con 0x7fa7a8058550 2026-02-13T03:49:45.931 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:45.926+0000 7fa7ad4626c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa7840b5600 0x7fa7840d5ab0 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa798005b40 tx=0x7fa7980091c0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:46.046 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.044+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa7a81004a0 con 0x7fa7a8058550 2026-02-13T03:49:46.047 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.044+0000 7fa7967fc6c0 1 -- 10.20.193.70:0/1291425245 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa79c0a9660 con 0x7fa7a8058550 2026-02-13T03:49:46.047 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:46.047 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:46.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa7840b5600 msgr2=0x7fa7840d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:46.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa7840b5600 0x7fa7840d5ab0 secure :-1 s=READY pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa798005b40 tx=0x7fa7980091c0 comp rx=0 tx=0).stop 2026-02-13T03:49:46.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8058550 msgr2=0x7fa7a80ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:46.048 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8058550 0x7fa7a80ff890 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa79c005dc0 tx=0x7fa79c00bbd0 comp rx=0 tx=0).stop 2026-02-13T03:49:46.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 shutdown_connections 2026-02-13T03:49:46.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fa7840b5600 0x7fa7840d5ab0 unknown :-1 s=CLOSED pgs=299 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:46.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7a815e0c0 0x7fa7a8104c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:46.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fa7a8058550 0x7fa7a80ff890 unknown :-1 s=CLOSED pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:46.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 --2- 10.20.193.70:0/1291425245 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fa7a8057c40 0x7fa7a80ff350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:46.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 >> 10.20.193.70:0/1291425245 conn(0x7fa7a805e060 msgr2=0x7fa7a80fa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:46.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 shutdown_connections 2026-02-13T03:49:46.049 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:46.046+0000 7fa7af6f16c0 1 -- 10.20.193.70:0/1291425245 wait complete. 2026-02-13T03:49:46.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:46 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1291425245' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:46.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:46 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1291425245' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:46.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:46 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1291425245' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:47.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:47 trial070 ceph-mon[24757]: pgmap v324: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:47.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:47 trial177 ceph-mon[27082]: pgmap v324: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:47.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:47 trial127 ceph-mon[26439]: pgmap v324: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:49.089 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:49.206 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:49.324 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.320+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3372861348 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10bd00 msgr2=0x7f0c9c175a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:49.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.320+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3372861348 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10bd00 0x7f0c9c175a70 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=18199870720178510920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c9000aa40 tx=0x7f0c9002fde0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.320+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3372861348 shutdown_connections 2026-02-13T03:49:49.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.320+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3372861348 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10bd00 0x7f0c9c175a70 unknown :-1 s=CLOSED pgs=465 gs=1 cs=0 l=1 c_cookie=18199870720178510920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.320+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3372861348 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c9c10b120 0x7f0c9c10b550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.320+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3372861348 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c9c10dad0 0x7f0c9c10dea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.320+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3372861348 >> 10.20.193.70:0/3372861348 conn(0x7f0c9c062e00 msgr2=0x7f0c9c109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:49.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.320+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3372861348 shutdown_connections 2026-02-13T03:49:49.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.320+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3372861348 wait complete. 2026-02-13T03:49:49.325 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 Processor -- start 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 -- start start 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10b120 0x7f0c9c0f5250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c9c10bd00 0x7f0c9c0f5790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c9c10dad0 0x7f0c9c0fab50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c0fb1a0 con 0x7f0c9c10b120 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c0fb310 con 0x7f0c9c10bd00 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c0fb4d0 con 0x7f0c9c10dad0 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9bfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10b120 0x7f0c9c0f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9bfff6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10b120 0x7f0c9c0f5250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:58236/0 (socket says 10.20.193.70:58236) 2026-02-13T03:49:49.326 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9bfff6c0 1 -- 10.20.193.70:0/3285374062 learned_addr learned my addr 10.20.193.70:0/3285374062 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca0ba36c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c9c10dad0 0x7f0c9c0fab50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9b7fe6c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c9c10bd00 0x7f0c9c0f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9bfff6c0 1 -- 10.20.193.70:0/3285374062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c9c10dad0 msgr2=0x7f0c9c0fab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9bfff6c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c9c10dad0 0x7f0c9c0fab50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9bfff6c0 1 -- 10.20.193.70:0/3285374062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c9c10bd00 msgr2=0x7f0c9c0f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9bfff6c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c9c10bd00 0x7f0c9c0f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9bfff6c0 1 -- 10.20.193.70:0/3285374062 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9000a660 con 0x7f0c9c10b120 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c9bfff6c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10b120 0x7f0c9c0f5250 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c88005dc0 tx=0x7f0c8800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c997fa6c0 1 -- 10.20.193.70:0/3285374062 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c88004250 con 0x7f0c9c10b120 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9c0fb7b0 con 0x7f0c9c10b120 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c997fa6c0 1 -- 10.20.193.70:0/3285374062 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0c88009070 con 0x7f0c9c10b120 2026-02-13T03:49:49.327 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0c997fa6c0 1 -- 10.20.193.70:0/3285374062 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c8800cd70 con 0x7f0c9c10b120 2026-02-13T03:49:49.328 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.321+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9c172bf0 con 0x7f0c9c10b120 2026-02-13T03:49:49.328 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.322+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c9c10c130 con 0x7f0c9c10b120 2026-02-13T03:49:49.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.323+0000 7f0c997fa6c0 1 -- 10.20.193.70:0/3285374062 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f0c880028c0 con 0x7f0c9c10b120 2026-02-13T03:49:49.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.323+0000 7f0c997fa6c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0c700b5680 0x7f0c700d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:49.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.324+0000 7f0c997fa6c0 1 -- 10.20.193.70:0/3285374062 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f0c880e3a00 con 0x7f0c9c10b120 2026-02-13T03:49:49.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.324+0000 7f0c9b7fe6c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0c700b5680 0x7f0c700d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:49.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.324+0000 7f0c997fa6c0 1 -- 10.20.193.70:0/3285374062 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0c880a6480 con 0x7f0c9c10b120 2026-02-13T03:49:49.329 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.324+0000 7f0c9b7fe6c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0c700b5680 0x7f0c700d5b30 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c8c006b60 tx=0x7f0c8c006af0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:49.443 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.441+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0c9c10dea0 con 0x7f0c9c10b120 2026-02-13T03:49:49.444 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:49 trial070 ceph-mon[24757]: pgmap v325: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:49.444 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.442+0000 7f0c997fa6c0 1 -- 10.20.193.70:0/3285374062 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0c880a9630 con 0x7f0c9c10b120 2026-02-13T03:49:49.445 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:49.445 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:49.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0c700b5680 msgr2=0x7f0c700d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:49.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0c700b5680 0x7f0c700d5b30 secure :-1 s=READY pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c8c006b60 tx=0x7f0c8c006af0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10b120 msgr2=0x7f0c9c0f5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:49.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10b120 0x7f0c9c0f5250 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c88005dc0 tx=0x7f0c8800bbb0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 shutdown_connections 2026-02-13T03:49:49.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0c700b5680 0x7f0c700d5b30 unknown :-1 s=CLOSED pgs=300 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c9c10dad0 0x7f0c9c0fab50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0c9c10bd00 0x7f0c9c0f5790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.446 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 --2- 10.20.193.70:0/3285374062 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0c9c10b120 0x7f0c9c0f5250 unknown :-1 s=CLOSED pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:49.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 >> 10.20.193.70:0/3285374062 conn(0x7f0c9c062e00 msgr2=0x7f0c9c0eba50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:49.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 shutdown_connections 2026-02-13T03:49:49.447 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:49.443+0000 7f0ca26316c0 1 -- 10.20.193.70:0/3285374062 wait complete. 2026-02-13T03:49:49.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:49 trial177 ceph-mon[27082]: pgmap v325: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:49.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:49 trial127 ceph-mon[26439]: pgmap v325: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:50.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:50 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/3285374062' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:50.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:50 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/3285374062' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:50.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:50 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/3285374062' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:51.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:51 trial070 ceph-mon[24757]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:51.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:51 trial177 ceph-mon[27082]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:51.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:51 trial127 ceph-mon[26439]: pgmap v326: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:52.487 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:52.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:52 trial070 ceph-mon[24757]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:52.606 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:52.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:52 trial177 ceph-mon[27082]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:52.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:52 trial127 ceph-mon[26439]: pgmap v327: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:52.728 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 -- 10.20.193.70:0/3289944858 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f935810fbf0 msgr2=0x7f9358114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:52.728 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/3289944858 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f935810fbf0 0x7f9358114c30 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=8572788544119069696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93480099a0 tx=0x7f934802ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:52.728 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 -- 10.20.193.70:0/3289944858 shutdown_connections 2026-02-13T03:49:52.728 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/3289944858 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f9358115410 0x7f9358175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.728 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/3289944858 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f935810fbf0 0x7f9358114c30 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=8572788544119069696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.728 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/3289944858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810f200 0x7f935810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.728 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 -- 10.20.193.70:0/3289944858 >> 10.20.193.70:0/3289944858 conn(0x7f93580ecb00 msgr2=0x7f935810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 -- 10.20.193.70:0/3289944858 shutdown_connections 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 -- 10.20.193.70:0/3289944858 wait complete. 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 Processor -- start 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.723+0000 7f935e82b6c0 1 -- start start 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f935e82b6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810f200 0x7f93580f4d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f935e82b6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9358115410 0x7f9358175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f935e82b6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93580f5380 0x7f93580fa650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f935e82b6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93580f5a70 con 0x7f9358115410 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f935e82b6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f93580fab90 con 0x7f93580f5380 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f935e82b6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f93580fad50 con 0x7f935810f200 2026-02-13T03:49:52.729 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93577fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9358115410 0x7f9358175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93577fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9358115410 0x7f9358175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:58258/0 (socket says 10.20.193.70:58258) 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93577fe6c0 1 -- 10.20.193.70:0/1931341373 learned_addr learned my addr 10.20.193.70:0/1931341373 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f935cd9d6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93580f5380 0x7f93580fa650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f9357fff6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810f200 0x7f93580f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93577fe6c0 1 -- 10.20.193.70:0/1931341373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810f200 msgr2=0x7f93580f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93577fe6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810f200 0x7f93580f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93577fe6c0 1 -- 10.20.193.70:0/1931341373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93580f5380 msgr2=0x7f93580fa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93577fe6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93580f5380 0x7f93580fa650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93577fe6c0 1 -- 10.20.193.70:0/1931341373 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9348009590 con 0x7f9358115410 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93577fe6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9358115410 0x7f9358175cb0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93480023c0 tx=0x7f934802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93557fa6c0 1 -- 10.20.193.70:0/1931341373 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9348002ae0 con 0x7f9358115410 2026-02-13T03:49:52.730 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93557fa6c0 1 -- 10.20.193.70:0/1931341373 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9348002c40 con 0x7f9358115410 2026-02-13T03:49:52.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93580fafd0 con 0x7f9358115410 2026-02-13T03:49:52.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f93557fa6c0 1 -- 10.20.193.70:0/1931341373 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93480372f0 con 0x7f9358115410 2026-02-13T03:49:52.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.724+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93580fb4a0 con 0x7f9358115410 2026-02-13T03:49:52.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.725+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93581104d0 con 0x7f9358115410 2026-02-13T03:49:52.731 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.726+0000 7f93557fa6c0 1 -- 10.20.193.70:0/1931341373 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f9348007810 con 0x7f9358115410 2026-02-13T03:49:52.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.726+0000 7f93557fa6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f932c0b5680 0x7f932c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:52.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.726+0000 7f93557fa6c0 1 -- 10.20.193.70:0/1931341373 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f9348107b70 con 0x7f9358115410 2026-02-13T03:49:52.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.726+0000 7f9357fff6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f932c0b5680 0x7f932c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:52.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.727+0000 7f93557fa6c0 1 -- 10.20.193.70:0/1931341373 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f93480ca5f0 con 0x7f9358115410 2026-02-13T03:49:52.732 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.727+0000 7f9357fff6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f932c0b5680 0x7f932c0d5b30 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9344005980 tx=0x7f9344005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:52.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.847+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f935810f5d0 con 0x7f9358115410 2026-02-13T03:49:52.850 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.848+0000 7f93557fa6c0 1 -- 10.20.193.70:0/1931341373 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9348007e60 con 0x7f9358115410 2026-02-13T03:49:52.850 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:52.850 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:52.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f932c0b5680 msgr2=0x7f932c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:52.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f932c0b5680 0x7f932c0d5b30 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9344005980 tx=0x7f9344005910 comp rx=0 tx=0).stop 2026-02-13T03:49:52.851 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9358115410 msgr2=0x7f9358175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:52.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9358115410 0x7f9358175cb0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93480023c0 tx=0x7f934802fbf0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 shutdown_connections 2026-02-13T03:49:52.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f932c0b5680 0x7f932c0d5b30 unknown :-1 s=CLOSED pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f93580f5380 0x7f93580fa650 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f9358115410 0x7f9358175cb0 unknown :-1 s=CLOSED pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 --2- 10.20.193.70:0/1931341373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810f200 0x7f93580f4d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:52.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 >> 10.20.193.70:0/1931341373 conn(0x7f93580ecb00 msgr2=0x7f9358111c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:52.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 shutdown_connections 2026-02-13T03:49:52.852 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:52.849+0000 7f935e82b6c0 1 -- 10.20.193.70:0/1931341373 wait complete. 2026-02-13T03:49:53.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:53 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1931341373' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:53.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:53 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1931341373' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:53.723 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:53 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1931341373' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:54.547 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:54 trial070 ceph-mon[24757]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:54.701 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:54 trial177 ceph-mon[27082]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:54.724 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:54 trial127 ceph-mon[26439]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:55.893 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:56.012 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:56.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.122+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2122716076 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c10cf80 msgr2=0x7fd08c10d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:56.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.122+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2122716076 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c10cf80 0x7fd08c10d350 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=3340856791184691357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd07c0099a0 tx=0x7fd07c02ed20 comp rx=0 tx=0).stop 2026-02-13T03:49:56.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.122+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2122716076 shutdown_connections 2026-02-13T03:49:56.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.122+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2122716076 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd08c113190 0x7fd08c173b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.122+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2122716076 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd08c10d970 0x7fd08c1129b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.122+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2122716076 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c10cf80 0x7fd08c10d350 unknown :-1 s=CLOSED pgs=469 gs=1 cs=0 l=1 c_cookie=3340856791184691357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.127 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.122+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2122716076 >> 10.20.193.70:0/2122716076 conn(0x7fd08c0ea880 msgr2=0x7fd08c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.122+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2122716076 shutdown_connections 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.122+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2122716076 wait complete. 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd0930bd6c0 1 Processor -- start 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd0930bd6c0 1 -- start start 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd0930bd6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd08c10cf80 0x7fd08c060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd0930bd6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd08c113190 0x7fd08c060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd0930bd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c061180 0x7fd08c163370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd0930bd6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c1638b0 con 0x7fd08c061180 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd0930bd6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c163a20 con 0x7fd08c10cf80 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd0930bd6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c163be0 con 0x7fd08c113190 2026-02-13T03:49:56.128 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd09162f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c061180 0x7fd08c163370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd09162f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c061180 0x7fd08c163370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43608/0 (socket says 10.20.193.70:43608) 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd09162f6c0 1 -- 10.20.193.70:0/2053170738 learned_addr learned my addr 10.20.193.70:0/2053170738 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd090e2e6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd08c10cf80 0x7fd08c060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd083fff6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd08c113190 0x7fd08c060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd09162f6c0 1 -- 10.20.193.70:0/2053170738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd08c113190 msgr2=0x7fd08c060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd09162f6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd08c113190 0x7fd08c060c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd09162f6c0 1 -- 10.20.193.70:0/2053170738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd08c10cf80 msgr2=0x7fd08c060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd09162f6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd08c10cf80 0x7fd08c060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd09162f6c0 1 -- 10.20.193.70:0/2053170738 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c009590 con 0x7fd08c061180 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd090e2e6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd08c10cf80 0x7fd08c060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd083fff6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd08c113190 0x7fd08c060c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd09162f6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c061180 0x7fd08c163370 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd088006ea0 tx=0x7fd08800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:56.129 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd081ffb6c0 1 -- 10.20.193.70:0/2053170738 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd088003a30 con 0x7fd08c061180 2026-02-13T03:49:56.130 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.123+0000 7fd081ffb6c0 1 -- 10.20.193.70:0/2053170738 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd0880054f0 con 0x7fd08c061180 2026-02-13T03:49:56.130 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.124+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08c163ec0 con 0x7fd08c061180 2026-02-13T03:49:56.130 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.124+0000 7fd081ffb6c0 1 -- 10.20.193.70:0/2053170738 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd08800dcd0 con 0x7fd08c061180 2026-02-13T03:49:56.130 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.124+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08c1643f0 con 0x7fd08c061180 2026-02-13T03:49:56.130 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.124+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd08c10e250 con 0x7fd08c061180 2026-02-13T03:49:56.131 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.125+0000 7fd081ffb6c0 1 -- 10.20.193.70:0/2053170738 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fd088005030 con 0x7fd08c061180 2026-02-13T03:49:56.131 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.126+0000 7fd081ffb6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0680b5680 0x7fd0680d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:56.131 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.126+0000 7fd090e2e6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0680b5680 0x7fd0680d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:56.131 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.126+0000 7fd081ffb6c0 1 -- 10.20.193.70:0/2053170738 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fd0880e4a50 con 0x7fd08c061180 2026-02-13T03:49:56.131 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.126+0000 7fd081ffb6c0 1 -- 10.20.193.70:0/2053170738 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd08811d5e0 con 0x7fd08c061180 2026-02-13T03:49:56.131 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.127+0000 7fd090e2e6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0680b5680 0x7fd0680d5b30 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd07c005b40 tx=0x7fd07c005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:56.245 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.243+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd08c061a00 con 0x7fd08c061180 2026-02-13T03:49:56.245 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.243+0000 7fd081ffb6c0 1 -- 10.20.193.70:0/2053170738 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd0880a7510 con 0x7fd08c061180 2026-02-13T03:49:56.246 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:56.246 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:56.247 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0680b5680 msgr2=0x7fd0680d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:56.247 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0680b5680 0x7fd0680d5b30 secure :-1 s=READY pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd07c005b40 tx=0x7fd07c005c00 comp rx=0 tx=0).stop 2026-02-13T03:49:56.247 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c061180 msgr2=0x7fd08c163370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:56.247 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c061180 0x7fd08c163370 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd088006ea0 tx=0x7fd08800cca0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.247 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 shutdown_connections 2026-02-13T03:49:56.247 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fd0680b5680 0x7fd0680d5b30 unknown :-1 s=CLOSED pgs=302 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.247 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fd08c061180 0x7fd08c163370 unknown :-1 s=CLOSED pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.247 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd08c113190 0x7fd08c060c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.248 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 --2- 10.20.193.70:0/2053170738 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fd08c10cf80 0x7fd08c060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:56.248 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 >> 10.20.193.70:0/2053170738 conn(0x7fd08c0ea880 msgr2=0x7fd08c10ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:56.248 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 shutdown_connections 2026-02-13T03:49:56.248 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:56.244+0000 7fd0930bd6c0 1 -- 10.20.193.70:0/2053170738 wait complete. 2026-02-13T03:49:56.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:56 trial070 ceph-mon[24757]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:56.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:56 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2053170738' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:56.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:56 trial177 ceph-mon[27082]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:56.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:56 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2053170738' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:56.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:56 trial127 ceph-mon[26439]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:49:56.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:56 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2053170738' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:49:58.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:49:58 trial070 ceph-mon[24757]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:58.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:49:58 trial177 ceph-mon[27082]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:58.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:49:58 trial127 ceph-mon[26439]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:49:59.289 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:49:59.410 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:49:59.534 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/3075103054 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798115410 msgr2=0x7fc798175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:59.534 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/3075103054 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798115410 0x7fc798175db0 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=3402466629254631383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc79400aa70 tx=0x7fc79402fde0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.534 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/3075103054 shutdown_connections 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/3075103054 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798115410 0x7fc798175db0 unknown :-1 s=CLOSED pgs=471 gs=1 cs=0 l=1 c_cookie=3402466629254631383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/3075103054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc79810fbf0 0x7fc798114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/3075103054 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc79810f200 0x7fc79810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/3075103054 >> 10.20.193.70:0/3075103054 conn(0x7fc7980ecb00 msgr2=0x7fc79810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/3075103054 shutdown_connections 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/3075103054 wait complete. 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 Processor -- start 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 -- start start 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc79810f200 0x7fc79811d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:59.535 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc798115410 0x7fc79811d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798122b50 0x7fc798122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc798123560 con 0x7fc798122b50 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981236d0 con 0x7fc798115410 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79fbbb6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc798123890 con 0x7fc79810f200 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79e12d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798122b50 0x7fc798122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79e12d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798122b50 0x7fc798122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43622/0 (socket says 10.20.193.70:43622) 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79e12d6c0 1 -- 10.20.193.70:0/1264743577 learned_addr learned my addr 10.20.193.70:0/1264743577 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79d92c6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc79810f200 0x7fc79811d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.530+0000 7fc79d12b6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc798115410 0x7fc79811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79e12d6c0 1 -- 10.20.193.70:0/1264743577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc79810f200 msgr2=0x7fc79811d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79e12d6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc79810f200 0x7fc79811d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.536 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79e12d6c0 1 -- 10.20.193.70:0/1264743577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc798115410 msgr2=0x7fc79811d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79e12d6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc798115410 0x7fc79811d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79e12d6c0 1 -- 10.20.193.70:0/1264743577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79400a660 con 0x7fc798122b50 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79d92c6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc79810f200 0x7fc79811d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79d12b6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc798115410 0x7fc79811d790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79e12d6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798122b50 0x7fc798122ff0 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7940054b0 tx=0x7fc7940054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc786ffd6c0 1 -- 10.20.193.70:0/1264743577 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc794003a30 con 0x7fc798122b50 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc786ffd6c0 1 -- 10.20.193.70:0/1264743577 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc794003b90 con 0x7fc798122b50 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc786ffd6c0 1 -- 10.20.193.70:0/1264743577 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7940372f0 con 0x7fc798122b50 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc798163ce0 con 0x7fc798122b50 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc798164110 con 0x7fc798122b50 2026-02-13T03:49:59.537 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.531+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7981104d0 con 0x7fc798122b50 2026-02-13T03:49:59.538 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.533+0000 7fc786ffd6c0 1 -- 10.20.193.70:0/1264743577 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fc794008260 con 0x7fc798122b50 2026-02-13T03:49:59.538 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.533+0000 7fc786ffd6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7740b5600 0x7fc7740d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:49:59.539 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.533+0000 7fc786ffd6c0 1 -- 10.20.193.70:0/1264743577 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fc794108e80 con 0x7fc798122b50 2026-02-13T03:49:59.539 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.533+0000 7fc79d92c6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7740b5600 0x7fc7740d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:49:59.539 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.534+0000 7fc79d92c6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7740b5600 0x7fc7740d5ab0 secure :-1 s=READY pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc788005fd0 tx=0x7fc7880092c0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:49:59.539 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.534+0000 7fc786ffd6c0 1 -- 10.20.193.70:0/1264743577 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc7940cb940 con 0x7fc798122b50 2026-02-13T03:49:59.654 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.652+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc79811e3a0 con 0x7fc798122b50 2026-02-13T03:49:59.654 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.653+0000 7fc786ffd6c0 1 -- 10.20.193.70:0/1264743577 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc794003d00 con 0x7fc798122b50 2026-02-13T03:49:59.654 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:49:59.655 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:49:59.656 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7740b5600 msgr2=0x7fc7740d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:59.657 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7740b5600 0x7fc7740d5ab0 secure :-1 s=READY pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc788005fd0 tx=0x7fc7880092c0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.657 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798122b50 msgr2=0x7fc798122ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:49:59.657 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798122b50 0x7fc798122ff0 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7940054b0 tx=0x7fc7940054e0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.657 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 shutdown_connections 2026-02-13T03:49:59.657 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc7740b5600 0x7fc7740d5ab0 unknown :-1 s=CLOSED pgs=303 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.657 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc798122b50 0x7fc798122ff0 unknown :-1 s=CLOSED pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.657 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc798115410 0x7fc79811d790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.657 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 --2- 10.20.193.70:0/1264743577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc79810f200 0x7fc79811d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:49:59.657 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 >> 10.20.193.70:0/1264743577 conn(0x7fc7980ecb00 msgr2=0x7fc79810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:49:59.658 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 shutdown_connections 2026-02-13T03:49:59.658 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:49:59.654+0000 7fc79fbbb6c0 1 -- 10.20.193.70:0/1264743577 wait complete. 2026-02-13T03:50:00.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:00.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1264743577' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:00.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T03:50:00.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T03:50:00.798 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial177 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpmy9738uu:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpns_w0w4g:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T03:50:00.799 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T03:50:00.800 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: Traceback (most recent call last): 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: return _run_code(code, main_globals, None, 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: exec(code, run_globals) 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T03:50:00.801 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T03:50:00.802 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T03:50:00.802 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T03:50:00.802 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:00 trial070 ceph-mon[24757]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial177 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpmy9738uu:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpns_w0w4g:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T03:50:00.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1264743577' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial177 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpmy9738uu:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpns_w0w4g:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T03:50:00.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T03:50:00.953 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: Traceback (most recent call last): 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: return _run_code(code, main_globals, None, 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: exec(code, run_globals) 2026-02-13T03:50:00.954 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T03:50:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T03:50:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T03:50:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T03:50:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T03:50:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T03:50:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T03:50:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T03:50:00.955 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:00 trial177 ceph-mon[27082]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial177 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpmy9738uu:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpns_w0w4g:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T03:50:00.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:00.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1264743577' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:00.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T03:50:00.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T03:50:00.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.c/config 2026-02-13T03:50:00.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial177 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpmy9738uu:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpns_w0w4g:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T03:50:00.975 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T03:50:00.976 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: Traceback (most recent call last): 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: return _run_code(code, main_globals, None, 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: exec(code, run_globals) 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T03:50:00.977 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: File "/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T03:50:00.978 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:00 trial127 ceph-mon[26439]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial177 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpmy9738uu:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpns_w0w4g:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T03:50:02.697 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:02.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:02 trial070 ceph-mon[24757]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:02.819 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:02.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.931+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/161702367 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e810fc20 msgr2=0x7f28e8114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:02.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.931+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/161702367 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e810fc20 0x7f28e8114c60 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=14078677786712144783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28d00099a0 tx=0x7f28d002ed50 comp rx=0 tx=0).stop 2026-02-13T03:50:02.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.931+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/161702367 shutdown_connections 2026-02-13T03:50:02.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.931+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/161702367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28e8115440 0x7f28e8175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:02.936 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.931+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/161702367 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e810fc20 0x7f28e8114c60 unknown :-1 s=CLOSED pgs=473 gs=1 cs=0 l=1 c_cookie=14078677786712144783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.931+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/161702367 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28e810f230 0x7f28e810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.931+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/161702367 >> 10.20.193.70:0/161702367 conn(0x7f28e80ecb30 msgr2=0x7f28e810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.931+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/161702367 shutdown_connections 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.931+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/161702367 wait complete. 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 Processor -- start 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 -- start start 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28e810f230 0x7f28e80f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28e8115440 0x7f28e8175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e80f5310 0x7f28e80fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:02.937 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80f5970 con 0x7f28e80f5310 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80faad0 con 0x7f28e8115440 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80fac90 con 0x7f28e810f230 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e77fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e80f5310 0x7f28e80fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e77fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e80f5310 0x7f28e80fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:43642/0 (socket says 10.20.193.70:43642) 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e77fe6c0 1 -- 10.20.193.70:0/700171638 learned_addr learned my addr 10.20.193.70:0/700171638 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e6ffd6c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28e810f230 0x7f28e80f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e77fe6c0 1 -- 10.20.193.70:0/700171638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28e810f230 msgr2=0x7f28e80f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e77fe6c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28e810f230 0x7f28e80f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e67fc6c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28e8115440 0x7f28e8175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e77fe6c0 1 -- 10.20.193.70:0/700171638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28e8115440 msgr2=0x7f28e8175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:02.938 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e77fe6c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28e8115440 0x7f28e8175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:02.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e77fe6c0 1 -- 10.20.193.70:0/700171638 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d0009590 con 0x7f28e80f5310 2026-02-13T03:50:02.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28e77fe6c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e80f5310 0x7f28e80fa590 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28d8006ea0 tx=0x7f28d800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:02.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ec8eb6c0 1 -- 10.20.193.70:0/700171638 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28d8003a30 con 0x7f28e80f5310 2026-02-13T03:50:02.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ec8eb6c0 1 -- 10.20.193.70:0/700171638 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f28d80054f0 con 0x7f28e80f5310 2026-02-13T03:50:02.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e80faf10 con 0x7f28e80f5310 2026-02-13T03:50:02.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ec8eb6c0 1 -- 10.20.193.70:0/700171638 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28d800dcd0 con 0x7f28e80f5310 2026-02-13T03:50:02.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.932+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e80fb3f0 con 0x7f28e80f5310 2026-02-13T03:50:02.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.933+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e8110500 con 0x7f28e80f5310 2026-02-13T03:50:02.939 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.934+0000 7f28ec8eb6c0 1 -- 10.20.193.70:0/700171638 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f28d8005030 con 0x7f28e80f5310 2026-02-13T03:50:02.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.935+0000 7f28ec8eb6c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28bc0b5680 0x7f28bc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:02.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.935+0000 7f28e6ffd6c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28bc0b5680 0x7f28bc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:02.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.935+0000 7f28ec8eb6c0 1 -- 10.20.193.70:0/700171638 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f28d80e4b00 con 0x7f28e80f5310 2026-02-13T03:50:02.940 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.935+0000 7f28e6ffd6c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28bc0b5680 0x7f28bc0d5b30 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28dc004750 tx=0x7f28dc005e60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:02.941 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:02.935+0000 7f28ec8eb6c0 1 -- 10.20.193.70:0/700171638 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f28d80a7580 con 0x7f28e80f5310 2026-02-13T03:50:02.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:02 trial177 ceph-mon[27082]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:02.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:02 trial127 ceph-mon[26439]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:03.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.053+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f28e810f600 con 0x7f28e80f5310 2026-02-13T03:50:03.055 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.053+0000 7f28ec8eb6c0 1 -- 10.20.193.70:0/700171638 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f28d80aa730 con 0x7f28e80f5310 2026-02-13T03:50:03.056 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:03.056 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:03.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28bc0b5680 msgr2=0x7f28bc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:03.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28bc0b5680 0x7f28bc0d5b30 secure :-1 s=READY pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28dc004750 tx=0x7f28dc005e60 comp rx=0 tx=0).stop 2026-02-13T03:50:03.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e80f5310 msgr2=0x7f28e80fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:03.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e80f5310 0x7f28e80fa590 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28d8006ea0 tx=0x7f28d800cca0 comp rx=0 tx=0).stop 2026-02-13T03:50:03.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 shutdown_connections 2026-02-13T03:50:03.057 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f28bc0b5680 0x7f28bc0d5b30 unknown :-1 s=CLOSED pgs=304 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:03.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f28e80f5310 0x7f28e80fa590 unknown :-1 s=CLOSED pgs=474 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:03.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f28e8115440 0x7f28e8175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:03.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 --2- 10.20.193.70:0/700171638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28e810f230 0x7f28e80f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:03.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 >> 10.20.193.70:0/700171638 conn(0x7f28e80ecb30 msgr2=0x7f28e810d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:03.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 shutdown_connections 2026-02-13T03:50:03.058 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:03.054+0000 7f28ed8f16c0 1 -- 10.20.193.70:0/700171638 wait complete. 2026-02-13T03:50:03.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:03 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/700171638' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:03.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:03 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/700171638' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:03.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:03 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/700171638' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:04.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:04 trial070 ceph-mon[24757]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:04.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:04 trial177 ceph-mon[27082]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:04.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:04 trial127 ceph-mon[26439]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:06.100 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:06.219 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:06.339 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2853143800 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810fc20 msgr2=0x7fef18114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:06.339 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2853143800 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810fc20 0x7fef18114c60 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=609769565866427866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef000099a0 tx=0x7fef0002ed00 comp rx=0 tx=0).stop 2026-02-13T03:50:06.339 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2853143800 shutdown_connections 2026-02-13T03:50:06.339 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2853143800 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef18115440 0x7fef18175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.339 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2853143800 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810fc20 0x7fef18114c60 unknown :-1 s=CLOSED pgs=475 gs=1 cs=0 l=1 c_cookie=609769565866427866 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2853143800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1810f230 0x7fef1810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2853143800 >> 10.20.193.70:0/2853143800 conn(0x7fef180ecb30 msgr2=0x7fef1810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2853143800 shutdown_connections 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2853143800 wait complete. 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 Processor -- start 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.335+0000 7fef1da6d6c0 1 -- start start 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1da6d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810f230 0x7fef180f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1da6d6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef18115440 0x7fef18175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1da6d6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef180f51f0 0x7fef180fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1da6d6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef180f5850 con 0x7fef1810f230 2026-02-13T03:50:06.340 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1da6d6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fef180faa00 con 0x7fef18115440 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1da6d6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef180fabc0 con 0x7fef180f51f0 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef16ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810f230 0x7fef180f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef16ffd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810f230 0x7fef180f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52144/0 (socket says 10.20.193.70:52144) 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef16ffd6c0 1 -- 10.20.193.70:0/2826992643 learned_addr learned my addr 10.20.193.70:0/2826992643 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef16ffd6c0 1 -- 10.20.193.70:0/2826992643 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef180f51f0 msgr2=0x7fef180fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef16ffd6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef180f51f0 0x7fef180fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef16ffd6c0 1 -- 10.20.193.70:0/2826992643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef18115440 msgr2=0x7fef18175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef16ffd6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef18115440 0x7fef18175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef16ffd6c0 1 -- 10.20.193.70:0/2826992643 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef00009590 con 0x7fef1810f230 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef16ffd6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810f230 0x7fef180f4bc0 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef0c00b6c0 tx=0x7fef0c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1ca676c0 1 -- 10.20.193.70:0/2826992643 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef0c004560 con 0x7fef1810f230 2026-02-13T03:50:06.341 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1ca676c0 1 -- 10.20.193.70:0/2826992643 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fef0c009030 con 0x7fef1810f230 2026-02-13T03:50:06.342 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef180fae40 con 0x7fef1810f230 2026-02-13T03:50:06.342 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1ca676c0 1 -- 10.20.193.70:0/2826992643 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef0c00cd90 con 0x7fef1810f230 2026-02-13T03:50:06.342 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef180fb630 con 0x7fef1810f230 2026-02-13T03:50:06.342 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.336+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef18110500 con 0x7fef1810f230 2026-02-13T03:50:06.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.338+0000 7fef1ca676c0 1 -- 10.20.193.70:0/2826992643 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fef0c0026b0 con 0x7fef1810f230 2026-02-13T03:50:06.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.338+0000 7fef1ca676c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feeec0b5680 0x7feeec0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:06.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.338+0000 7fef167fc6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feeec0b5680 0x7feeec0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:06.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.338+0000 7fef1ca676c0 1 -- 10.20.193.70:0/2826992643 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fef0c0e3900 con 0x7fef1810f230 2026-02-13T03:50:06.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.339+0000 7fef167fc6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feeec0b5680 0x7feeec0d5b30 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef000098c0 tx=0x7fef00005bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:06.343 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.339+0000 7fef1ca676c0 1 -- 10.20.193.70:0/2826992643 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fef0c0a6380 con 0x7fef1810f230 2026-02-13T03:50:06.458 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.456+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fef180f5d10 con 0x7fef1810f230 2026-02-13T03:50:06.458 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.456+0000 7fef1ca676c0 1 -- 10.20.193.70:0/2826992643 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fef0c0a9530 con 0x7fef1810f230 2026-02-13T03:50:06.459 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:06.459 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:06.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feeec0b5680 msgr2=0x7feeec0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:06.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feeec0b5680 0x7feeec0d5b30 secure :-1 s=READY pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef000098c0 tx=0x7fef00005bc0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810f230 msgr2=0x7fef180f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:06.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810f230 0x7fef180f4bc0 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef0c00b6c0 tx=0x7fef0c00bb90 comp rx=0 tx=0).stop 2026-02-13T03:50:06.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 shutdown_connections 2026-02-13T03:50:06.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7feeec0b5680 0x7feeec0d5b30 unknown :-1 s=CLOSED pgs=305 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.460 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef180f51f0 0x7fef180fa4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fef18115440 0x7fef18175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 --2- 10.20.193.70:0/2826992643 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fef1810f230 0x7fef180f4bc0 unknown :-1 s=CLOSED pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:06.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 >> 10.20.193.70:0/2826992643 conn(0x7fef180ecb30 msgr2=0x7fef1810d850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:06.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 shutdown_connections 2026-02-13T03:50:06.461 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:06.457+0000 7fef1da6d6c0 1 -- 10.20.193.70:0/2826992643 wait complete. 2026-02-13T03:50:06.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:06 trial070 ceph-mon[24757]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:06.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:06 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2826992643' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:06.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:06 trial177 ceph-mon[27082]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:06.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:06 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2826992643' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:06.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:06 trial127 ceph-mon[26439]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:06.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:06 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2826992643' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:08.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:08 trial070 ceph-mon[24757]: pgmap v335: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:08.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:08 trial177 ceph-mon[27082]: pgmap v335: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:08.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:08 trial127 ceph-mon[26439]: pgmap v335: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:09.500 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:09.621 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:09.753 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 -- 10.20.193.70:0/1321472182 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c115440 msgr2=0x7f950c175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:09.753 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 --2- 10.20.193.70:0/1321472182 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c115440 0x7f950c175de0 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=4886302996885283170 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94fc00aa70 tx=0x7f94fc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.753 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 -- 10.20.193.70:0/1321472182 shutdown_connections 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 --2- 10.20.193.70:0/1321472182 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c115440 0x7f950c175de0 unknown :-1 s=CLOSED pgs=477 gs=1 cs=0 l=1 c_cookie=4886302996885283170 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 --2- 10.20.193.70:0/1321472182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f950c10fc20 0x7f950c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 --2- 10.20.193.70:0/1321472182 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f950c10f230 0x7f950c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 -- 10.20.193.70:0/1321472182 >> 10.20.193.70:0/1321472182 conn(0x7f950c0ecb30 msgr2=0x7f950c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 -- 10.20.193.70:0/1321472182 shutdown_connections 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 -- 10.20.193.70:0/1321472182 wait complete. 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 Processor -- start 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 -- start start 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c10f230 0x7f950c11d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:09.754 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f950c115440 0x7f950c11d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f950c122ae0 0x7f950c122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1234c0 con 0x7f950c10f230 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f950c123630 con 0x7f950c115440 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f95112396c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1237f0 con 0x7f950c122ae0 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f950ad766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c10f230 0x7f950c11d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f950ad766c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c10f230 0x7f950c11d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52156/0 (socket says 10.20.193.70:52156) 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f950ad766c0 1 -- 10.20.193.70:0/2879073225 learned_addr learned my addr 10.20.193.70:0/2879073225 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f950a5756c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f950c115440 0x7f950c11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.749+0000 7f950b5776c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f950c122ae0 0x7f950c122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f950ad766c0 1 -- 10.20.193.70:0/2879073225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f950c122ae0 msgr2=0x7f950c122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f950ad766c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f950c122ae0 0x7f950c122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.755 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f950ad766c0 1 -- 10.20.193.70:0/2879073225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f950c115440 msgr2=0x7f950c11d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:09.756 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f950ad766c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f950c115440 0x7f950c11d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.756 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f950ad766c0 1 -- 10.20.193.70:0/2879073225 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc00a660 con 0x7f950c10f230 2026-02-13T03:50:09.756 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f950ad766c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c10f230 0x7f950c11d1e0 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f950000b6c0 tx=0x7f950000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:09.756 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f94ebfff6c0 1 -- 10.20.193.70:0/2879073225 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9500004560 con 0x7f950c10f230 2026-02-13T03:50:09.756 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950c163c70 con 0x7f950c10f230 2026-02-13T03:50:09.756 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f94ebfff6c0 1 -- 10.20.193.70:0/2879073225 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9500009030 con 0x7f950c10f230 2026-02-13T03:50:09.756 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f94ebfff6c0 1 -- 10.20.193.70:0/2879073225 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f950000cd90 con 0x7f950c10f230 2026-02-13T03:50:09.756 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950c1641a0 con 0x7f950c10f230 2026-02-13T03:50:09.756 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.750+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f950c110500 con 0x7f950c10f230 2026-02-13T03:50:09.757 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.752+0000 7f94ebfff6c0 1 -- 10.20.193.70:0/2879073225 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f95000026b0 con 0x7f950c10f230 2026-02-13T03:50:09.757 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.752+0000 7f94ebfff6c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94e00b5600 0x7f94e00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:09.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.753+0000 7f950a5756c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94e00b5600 0x7f94e00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:09.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.753+0000 7f94ebfff6c0 1 -- 10.20.193.70:0/2879073225 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f95000e3800 con 0x7f950c10f230 2026-02-13T03:50:09.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.753+0000 7f950a5756c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94e00b5600 0x7f94e00d5ab0 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f950c123b70 tx=0x7f94f4009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:09.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.753+0000 7f94ebfff6c0 1 -- 10.20.193.70:0/2879073225 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f95000a62c0 con 0x7f950c10f230 2026-02-13T03:50:09.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.874+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f950c11e330 con 0x7f950c10f230 2026-02-13T03:50:09.876 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.874+0000 7f94ebfff6c0 1 -- 10.20.193.70:0/2879073225 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f95000a9470 con 0x7f950c10f230 2026-02-13T03:50:09.877 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:09.877 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:09.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94e00b5600 msgr2=0x7f94e00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:09.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94e00b5600 0x7f94e00d5ab0 secure :-1 s=READY pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f950c123b70 tx=0x7f94f4009390 comp rx=0 tx=0).stop 2026-02-13T03:50:09.878 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c10f230 msgr2=0x7f950c11d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:09.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c10f230 0x7f950c11d1e0 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f950000b6c0 tx=0x7f950000bb90 comp rx=0 tx=0).stop 2026-02-13T03:50:09.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 shutdown_connections 2026-02-13T03:50:09.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f94e00b5600 0x7f94e00d5ab0 unknown :-1 s=CLOSED pgs=306 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f950c122ae0 0x7f950c122f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f950c115440 0x7f950c11d720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 --2- 10.20.193.70:0/2879073225 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f950c10f230 0x7f950c11d1e0 unknown :-1 s=CLOSED pgs=478 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:09.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 >> 10.20.193.70:0/2879073225 conn(0x7f950c0ecb30 msgr2=0x7f950c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:09.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 shutdown_connections 2026-02-13T03:50:09.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:09.875+0000 7f95112396c0 1 -- 10.20.193.70:0/2879073225 wait complete. 2026-02-13T03:50:10.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:10 trial070 ceph-mon[24757]: pgmap v336: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:10.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:10 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2879073225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:10.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:10 trial177 ceph-mon[27082]: pgmap v336: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:10.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:10 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2879073225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:10.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:10 trial127 ceph-mon[26439]: pgmap v336: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:10.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:10 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2879073225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:12.921 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:12.945 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:12 trial070 ceph-mon[24757]: pgmap v337: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:12.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:12 trial177 ceph-mon[27082]: pgmap v337: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:12.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:12 trial127 ceph-mon[26439]: pgmap v337: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:13.039 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:13.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/3819239804 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410fc20 msgr2=0x7ff0d4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:13.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/3819239804 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410fc20 0x7ff0d4114c60 secure :-1 s=READY pgs=479 gs=3 cs=0 l=1 c_cookie=4870773877791084425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0bc0099a0 tx=0x7ff0bc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:50:13.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/3819239804 shutdown_connections 2026-02-13T03:50:13.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/3819239804 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0d4115440 0x7ff0d4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/3819239804 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410fc20 0x7ff0d4114c60 unknown :-1 s=CLOSED pgs=479 gs=3 cs=0 l=1 c_cookie=4870773877791084425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/3819239804 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff0d410f230 0x7ff0d410f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/3819239804 >> 10.20.193.70:0/3819239804 conn(0x7ff0d40ecb30 msgr2=0x7ff0d410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/3819239804 shutdown_connections 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/3819239804 wait complete. 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 Processor -- start 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 -- start start 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410f230 0x7ff0d40f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0d4115440 0x7ff0d4175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff0d40f5270 0x7ff0d40fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40f5960 con 0x7ff0d410f230 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40faa80 con 0x7ff0d40f5270 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d8b8c6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40fac40 con 0x7ff0d4115440 2026-02-13T03:50:13.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d25756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410f230 0x7ff0d40f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d25756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410f230 0x7ff0d40f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:52188/0 (socket says 10.20.193.70:52188) 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d25756c0 1 -- 10.20.193.70:0/2952144884 learned_addr learned my addr 10.20.193.70:0/2952144884 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d2d766c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff0d40f5270 0x7ff0d40fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d25756c0 1 -- 10.20.193.70:0/2952144884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0d4115440 msgr2=0x7ff0d4175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d25756c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0d4115440 0x7ff0d4175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d25756c0 1 -- 10.20.193.70:0/2952144884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff0d40f5270 msgr2=0x7ff0d40fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d25756c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff0d40f5270 0x7ff0d40fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.154+0000 7ff0d25756c0 1 -- 10.20.193.70:0/2952144884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc009590 con 0x7ff0d410f230 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.155+0000 7ff0d25756c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410f230 0x7ff0d40f4c40 secure :-1 s=READY pgs=480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0c8009490 tx=0x7ff0c800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.155+0000 7ff0bb7fe6c0 1 -- 10.20.193.70:0/2952144884 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0c8004a80 con 0x7ff0d410f230 2026-02-13T03:50:13.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.155+0000 7ff0bb7fe6c0 1 -- 10.20.193.70:0/2952144884 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff0c8009030 con 0x7ff0d410f230 2026-02-13T03:50:13.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.155+0000 7ff0bb7fe6c0 1 -- 10.20.193.70:0/2952144884 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0c800ce30 con 0x7ff0d410f230 2026-02-13T03:50:13.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.155+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d40faf20 con 0x7ff0d410f230 2026-02-13T03:50:13.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.155+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d40fb3b0 con 0x7ff0d410f230 2026-02-13T03:50:13.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.155+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d4110500 con 0x7ff0d410f230 2026-02-13T03:50:13.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.157+0000 7ff0bb7fe6c0 1 -- 10.20.193.70:0/2952144884 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff0c8004060 con 0x7ff0d410f230 2026-02-13T03:50:13.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.157+0000 7ff0bb7fe6c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff0ac0b5600 0x7ff0ac0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:13.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.157+0000 7ff0d1d746c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff0ac0b5600 0x7ff0ac0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:13.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.158+0000 7ff0bb7fe6c0 1 -- 10.20.193.70:0/2952144884 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7ff0c80e38d0 con 0x7ff0d410f230 2026-02-13T03:50:13.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.158+0000 7ff0bb7fe6c0 1 -- 10.20.193.70:0/2952144884 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff0c80e3dc0 con 0x7ff0d410f230 2026-02-13T03:50:13.163 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.158+0000 7ff0d1d746c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff0ac0b5600 0x7ff0ac0d5ab0 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0bc0098c0 tx=0x7ff0bc005bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:13.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.275+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff0d40fb3b0 con 0x7ff0d410f230 2026-02-13T03:50:13.278 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.276+0000 7ff0bb7fe6c0 1 -- 10.20.193.70:0/2952144884 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff0d40fb3b0 con 0x7ff0d410f230 2026-02-13T03:50:13.278 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:13.278 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:13.279 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff0ac0b5600 msgr2=0x7ff0ac0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:13.279 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff0ac0b5600 0x7ff0ac0d5ab0 secure :-1 s=READY pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0bc0098c0 tx=0x7ff0bc005bc0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.279 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410f230 msgr2=0x7ff0d40f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:13.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410f230 0x7ff0d40f4c40 secure :-1 s=READY pgs=480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0c8009490 tx=0x7ff0c800bca0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 shutdown_connections 2026-02-13T03:50:13.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff0ac0b5600 0x7ff0ac0d5ab0 unknown :-1 s=CLOSED pgs=307 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff0d40f5270 0x7ff0d40fa540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0d4115440 0x7ff0d4175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 --2- 10.20.193.70:0/2952144884 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff0d410f230 0x7ff0d40f4c40 unknown :-1 s=CLOSED pgs=480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:13.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 >> 10.20.193.70:0/2952144884 conn(0x7ff0d40ecb30 msgr2=0x7ff0d410d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:13.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 shutdown_connections 2026-02-13T03:50:13.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:13.277+0000 7ff0d8b8c6c0 1 -- 10.20.193.70:0/2952144884 wait complete. 2026-02-13T03:50:13.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:13 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2952144884' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:13.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:13 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2952144884' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:14.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:13 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2952144884' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:14.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:14 trial177 ceph-mon[27082]: pgmap v338: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:14.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:14 trial127 ceph-mon[26439]: pgmap v338: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:15.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:14 trial070 ceph-mon[24757]: pgmap v338: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:16.321 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:16.441 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:16.562 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 -- 10.20.193.70:0/4100504372 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 msgr2=0x7fc180175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:16.562 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4100504372 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 0x7fc180175db0 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=11193435473353996278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc17c00aa70 tx=0x7fc17c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.562 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 -- 10.20.193.70:0/4100504372 shutdown_connections 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4100504372 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 0x7fc180175db0 unknown :-1 s=CLOSED pgs=481 gs=1 cs=0 l=1 c_cookie=11193435473353996278 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4100504372 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc18010fbf0 0x7fc180114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4100504372 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc18010f200 0x7fc18010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 -- 10.20.193.70:0/4100504372 >> 10.20.193.70:0/4100504372 conn(0x7fc1800ecb00 msgr2=0x7fc18010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 -- 10.20.193.70:0/4100504372 shutdown_connections 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 -- 10.20.193.70:0/4100504372 wait complete. 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 Processor -- start 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 -- start start 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc18010f200 0x7fc18011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:16.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 0x7fc18011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc180122b50 0x7fc180122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc180123530 con 0x7fc180115410 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7fc1801236a0 con 0x7fc180122b50 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.558+0000 7fc1879056c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc180123860 con 0x7fc18010f200 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc184e756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 0x7fc18011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc184e756c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 0x7fc18011d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:54102/0 (socket says 10.20.193.70:54102) 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc184e756c0 1 -- 10.20.193.70:0/4185599551 learned_addr learned my addr 10.20.193.70:0/4185599551 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc184e756c0 1 -- 10.20.193.70:0/4185599551 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc18010f200 msgr2=0x7fc18011d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc185e776c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc180122b50 0x7fc180122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc184e756c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc18010f200 0x7fc18011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.564 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc184e756c0 1 -- 10.20.193.70:0/4185599551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc180122b50 msgr2=0x7fc180122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc184e756c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc180122b50 0x7fc180122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc184e756c0 1 -- 10.20.193.70:0/4185599551 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c00a660 con 0x7fc180115410 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc185e776c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc180122b50 0x7fc180122ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc184e756c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 0x7fc18011d790 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc17400b6c0 tx=0x7fc17400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc16e7fc6c0 1 -- 10.20.193.70:0/4185599551 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc174004250 con 0x7fc180115410 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc16e7fc6c0 1 -- 10.20.193.70:0/4185599551 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc174009070 con 0x7fc180115410 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc180163ce0 con 0x7fc180115410 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc16e7fc6c0 1 -- 10.20.193.70:0/4185599551 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc17400ccb0 con 0x7fc180115410 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc180164170 con 0x7fc180115410 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.559+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1801104d0 con 0x7fc180115410 2026-02-13T03:50:16.565 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.560+0000 7fc16e7fc6c0 1 -- 10.20.193.70:0/4185599551 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7fc1740028c0 con 0x7fc180115410 2026-02-13T03:50:16.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.561+0000 7fc16e7fc6c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc15c0b5600 0x7fc15c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:16.566 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.561+0000 7fc1856766c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc15c0b5600 0x7fc15c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:16.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.561+0000 7fc16e7fc6c0 1 -- 10.20.193.70:0/4185599551 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7fc1740e3a90 con 0x7fc180115410 2026-02-13T03:50:16.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.561+0000 7fc1856766c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc15c0b5600 0x7fc15c0d5ab0 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc170004750 tx=0x7fc170005d30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:16.567 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.562+0000 7fc16e7fc6c0 1 -- 10.20.193.70:0/4185599551 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc1740a6510 con 0x7fc180115410 2026-02-13T03:50:16.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.678+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc18011e3a0 con 0x7fc180115410 2026-02-13T03:50:16.681 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:16 trial070 ceph-mon[24757]: pgmap v339: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:16.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.678+0000 7fc16e7fc6c0 1 -- 10.20.193.70:0/4185599551 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc1740a96c0 con 0x7fc180115410 2026-02-13T03:50:16.681 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:16.682 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:16.682 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc15c0b5600 msgr2=0x7fc15c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc15c0b5600 0x7fc15c0d5ab0 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc170004750 tx=0x7fc170005d30 comp rx=0 tx=0).stop 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 msgr2=0x7fc18011d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 0x7fc18011d790 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc17400b6c0 tx=0x7fc17400bb90 comp rx=0 tx=0).stop 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 shutdown_connections 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7fc15c0b5600 0x7fc15c0d5ab0 unknown :-1 s=CLOSED pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7fc180122b50 0x7fc180122ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7fc180115410 0x7fc18011d790 unknown :-1 s=CLOSED pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 --2- 10.20.193.70:0/4185599551 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc18010f200 0x7fc18011d250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.679+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 >> 10.20.193.70:0/4185599551 conn(0x7fc1800ecb00 msgr2=0x7fc18010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.680+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 shutdown_connections 2026-02-13T03:50:16.683 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:16.680+0000 7fc1879056c0 1 -- 10.20.193.70:0/4185599551 wait complete. 2026-02-13T03:50:16.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:16 trial177 ceph-mon[27082]: pgmap v339: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:16.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:16 trial127 ceph-mon[26439]: pgmap v339: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:17.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:17 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/4185599551' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:17.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:17 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/4185599551' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:18.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:17 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/4185599551' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:18.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:18 trial177 ceph-mon[27082]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:18.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:18 trial127 ceph-mon[26439]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:19.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:18 trial070 ceph-mon[24757]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:19.724 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:19.842 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:19.962 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.958+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/3156298453 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e2810fc20 msgr2=0x7f0e28114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:19.963 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.958+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/3156298453 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e2810fc20 0x7f0e28114c60 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=9621984570481318144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e180099a0 tx=0x7f0e1802ed20 comp rx=0 tx=0).stop 2026-02-13T03:50:19.963 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.958+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/3156298453 shutdown_connections 2026-02-13T03:50:19.963 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.958+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/3156298453 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e28115440 0x7f0e28175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:19.963 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.958+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/3156298453 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e2810fc20 0x7f0e28114c60 unknown :-1 s=CLOSED pgs=483 gs=1 cs=0 l=1 c_cookie=9621984570481318144 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:19.963 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.958+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/3156298453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e2810f230 0x7f0e2810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:19.963 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.958+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/3156298453 >> 10.20.193.70:0/3156298453 conn(0x7f0e280ecb30 msgr2=0x7f0e2810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:19.963 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.958+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/3156298453 shutdown_connections 2026-02-13T03:50:19.963 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.958+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/3156298453 wait complete. 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 Processor -- start 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 -- start start 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e2810f230 0x7f0e280f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e28115440 0x7f0e28175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e280f5270 0x7f0e280fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280f5960 con 0x7f0e28115440 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280faa80 con 0x7f0e2810f230 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280fac40 con 0x7f0e280f5270 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e277fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e28115440 0x7f0e28175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e277fe6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e28115440 0x7f0e28175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:54120/0 (socket says 10.20.193.70:54120) 2026-02-13T03:50:19.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e277fe6c0 1 -- 10.20.193.70:0/2600798968 learned_addr learned my addr 10.20.193.70:0/2600798968 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e27fff6c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e2810f230 0x7f0e280f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2cbd66c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e280f5270 0x7f0e280fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e277fe6c0 1 -- 10.20.193.70:0/2600798968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e280f5270 msgr2=0x7f0e280fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e277fe6c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e280f5270 0x7f0e280fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e277fe6c0 1 -- 10.20.193.70:0/2600798968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e2810f230 msgr2=0x7f0e280f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e277fe6c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e2810f230 0x7f0e280f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e277fe6c0 1 -- 10.20.193.70:0/2600798968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e18009590 con 0x7f0e28115440 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e277fe6c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e28115440 0x7f0e28175ce0 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e180023c0 tx=0x7f0e1802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e257fa6c0 1 -- 10.20.193.70:0/2600798968 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e18002ae0 con 0x7f0e28115440 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e257fa6c0 1 -- 10.20.193.70:0/2600798968 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0e18002c40 con 0x7f0e28115440 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e257fa6c0 1 -- 10.20.193.70:0/2600798968 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e180372f0 con 0x7f0e28115440 2026-02-13T03:50:19.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e280faec0 con 0x7f0e28115440 2026-02-13T03:50:19.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.959+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e280fb2f0 con 0x7f0e28115440 2026-02-13T03:50:19.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.960+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e28110500 con 0x7f0e28115440 2026-02-13T03:50:19.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.961+0000 7f0e257fa6c0 1 -- 10.20.193.70:0/2600798968 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f0e18007810 con 0x7f0e28115440 2026-02-13T03:50:19.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.962+0000 7f0e257fa6c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0dfc0b5600 0x7f0dfc0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:19.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.962+0000 7f0e27fff6c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0dfc0b5600 0x7f0dfc0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:19.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.962+0000 7f0e257fa6c0 1 -- 10.20.193.70:0/2600798968 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f0e18107c30 con 0x7f0e28115440 2026-02-13T03:50:19.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.962+0000 7f0e27fff6c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0dfc0b5600 0x7f0dfc0d5ab0 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e14005980 tx=0x7f0e14005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:19.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:19.962+0000 7f0e257fa6c0 1 -- 10.20.193.70:0/2600798968 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0e180ca6f0 con 0x7f0e28115440 2026-02-13T03:50:20.082 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.080+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0e2810f600 con 0x7f0e28115440 2026-02-13T03:50:20.083 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.081+0000 7f0e257fa6c0 1 -- 10.20.193.70:0/2600798968 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0e18007e60 con 0x7f0e28115440 2026-02-13T03:50:20.083 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:20.083 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:20.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.081+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0dfc0b5600 msgr2=0x7f0dfc0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:20.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.081+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0dfc0b5600 0x7f0dfc0d5ab0 secure :-1 s=READY pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e14005980 tx=0x7f0e14005910 comp rx=0 tx=0).stop 2026-02-13T03:50:20.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.081+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e28115440 msgr2=0x7f0e28175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:20.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.081+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e28115440 0x7f0e28175ce0 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e180023c0 tx=0x7f0e1802fbf0 comp rx=0 tx=0).stop 2026-02-13T03:50:20.084 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.082+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 shutdown_connections 2026-02-13T03:50:20.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.082+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0dfc0b5600 0x7f0dfc0d5ab0 unknown :-1 s=CLOSED pgs=309 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:20.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.082+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e280f5270 0x7f0e280fa540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:20.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.082+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0e28115440 0x7f0e28175ce0 unknown :-1 s=CLOSED pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:20.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.082+0000 7f0e2e6606c0 1 --2- 10.20.193.70:0/2600798968 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0e2810f230 0x7f0e280f4c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:20.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.082+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 >> 10.20.193.70:0/2600798968 conn(0x7f0e280ecb30 msgr2=0x7f0e2810d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:20.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.082+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 shutdown_connections 2026-02-13T03:50:20.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:20.082+0000 7f0e2e6606c0 1 -- 10.20.193.70:0/2600798968 wait complete. 2026-02-13T03:50:20.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:20 trial177 ceph-mon[27082]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:20.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:20 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2600798968' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:20.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:20 trial127 ceph-mon[26439]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:20.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:20 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2600798968' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:21.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:20 trial070 ceph-mon[24757]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:21.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:20 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2600798968' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:22.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:22 trial177 ceph-mon[27082]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:22.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:22 trial127 ceph-mon[26439]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:23.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:22 trial070 ceph-mon[24757]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:23.126 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:23.245 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:23.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.358+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/3085395354 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68701185f0 msgr2=0x7f687011d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:23.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.358+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/3085395354 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68701185f0 0x7f687011d630 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=14918097048095614878 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68640099a0 tx=0x7f686402ed20 comp rx=0 tx=0).stop 2026-02-13T03:50:23.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.358+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/3085395354 shutdown_connections 2026-02-13T03:50:23.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.358+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/3085395354 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f687011de10 0x7f687017e7b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.358+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/3085395354 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f68701185f0 0x7f687011d630 unknown :-1 s=CLOSED pgs=485 gs=1 cs=0 l=1 c_cookie=14918097048095614878 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.358+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/3085395354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6870117c00 0x7f6870117fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.358+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/3085395354 >> 10.20.193.70:0/3085395354 conn(0x7f68700f54a0 msgr2=0x7f68701158b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:23.363 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.358+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/3085395354 shutdown_connections 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.358+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/3085395354 wait complete. 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 Processor -- start 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 -- start start 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6870117c00 0x7f68700fd640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f687011de10 0x7f687017e6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68700fdc70 0x7f6870102f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68700fe360 con 0x7f687011de10 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f6870103480 con 0x7f68700fdc70 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6870103640 con 0x7f6870117c00 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68751af6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f687011de10 0x7f687017e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:23.364 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68751af6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f687011de10 0x7f687017e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:54130/0 (socket says 10.20.193.70:54130) 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68751af6c0 1 -- 10.20.193.70:0/2152155252 learned_addr learned my addr 10.20.193.70:0/2152155252 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68759b06c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6870117c00 0x7f68700fd640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68761b16c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68700fdc70 0x7f6870102f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68751af6c0 1 -- 10.20.193.70:0/2152155252 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6870117c00 msgr2=0x7f68700fd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68751af6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6870117c00 0x7f68700fd640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68751af6c0 1 -- 10.20.193.70:0/2152155252 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68700fdc70 msgr2=0x7f6870102f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68751af6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68700fdc70 0x7f6870102f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68751af6c0 1 -- 10.20.193.70:0/2152155252 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6864009590 con 0x7f687011de10 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68761b16c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68700fdc70 0x7f6870102f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f68751af6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f687011de10 0x7f687017e6b0 secure :-1 s=READY pgs=486 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68640023c0 tx=0x7f686402fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f685effd6c0 1 -- 10.20.193.70:0/2152155252 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6864002ae0 con 0x7f687011de10 2026-02-13T03:50:23.365 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f685effd6c0 1 -- 10.20.193.70:0/2152155252 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6864002c40 con 0x7f687011de10 2026-02-13T03:50:23.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68701038c0 con 0x7f687011de10 2026-02-13T03:50:23.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f685effd6c0 1 -- 10.20.193.70:0/2152155252 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68640372f0 con 0x7f687011de10 2026-02-13T03:50:23.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.359+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6870103d90 con 0x7f687011de10 2026-02-13T03:50:23.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.360+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6870118ed0 con 0x7f687011de10 2026-02-13T03:50:23.366 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.361+0000 7f685effd6c0 1 -- 10.20.193.70:0/2152155252 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f6864007810 con 0x7f687011de10 2026-02-13T03:50:23.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.362+0000 7f685effd6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f684c0b5680 0x7f684c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:23.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.362+0000 7f68759b06c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f684c0b5680 0x7f684c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:23.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.362+0000 7f685effd6c0 1 -- 10.20.193.70:0/2152155252 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f6864107b70 con 0x7f687011de10 2026-02-13T03:50:23.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.362+0000 7f68759b06c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f684c0b5680 0x7f684c0d5b30 secure :-1 s=READY pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6860005980 tx=0x7f6860005ee0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:23.367 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.362+0000 7f685effd6c0 1 -- 10.20.193.70:0/2152155252 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f68640ca5f0 con 0x7f687011de10 2026-02-13T03:50:23.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.479+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6870117fd0 con 0x7f687011de10 2026-02-13T03:50:23.481 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.479+0000 7f685effd6c0 1 -- 10.20.193.70:0/2152155252 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6864007e60 con 0x7f687011de10 2026-02-13T03:50:23.481 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:23.482 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:23.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f684c0b5680 msgr2=0x7f684c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:23.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f684c0b5680 0x7f684c0d5b30 secure :-1 s=READY pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6860005980 tx=0x7f6860005ee0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f687011de10 msgr2=0x7f687017e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:23.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f687011de10 0x7f687017e6b0 secure :-1 s=READY pgs=486 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68640023c0 tx=0x7f686402fbf0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 shutdown_connections 2026-02-13T03:50:23.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f684c0b5680 0x7f684c0d5b30 unknown :-1 s=CLOSED pgs=310 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f68700fdc70 0x7f6870102f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.483 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f687011de10 0x7f687017e6b0 unknown :-1 s=CLOSED pgs=486 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 --2- 10.20.193.70:0/2152155252 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6870117c00 0x7f68700fd640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:23.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 >> 10.20.193.70:0/2152155252 conn(0x7f68700f54a0 msgr2=0x7f687011c770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:23.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 shutdown_connections 2026-02-13T03:50:23.484 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:23.480+0000 7f6877c3f6c0 1 -- 10.20.193.70:0/2152155252 wait complete. 2026-02-13T03:50:23.797 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:23 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2152155252' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:23.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:23 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2152155252' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:23.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:23 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2152155252' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:24.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:24 trial177 ceph-mon[27082]: pgmap v343: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:24.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:24 trial127 ceph-mon[26439]: pgmap v343: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:25.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:24 trial070 ceph-mon[24757]: pgmap v343: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:26.523 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:26.642 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:26.757 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/231776203 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 msgr2=0x7f1980173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:26.757 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/231776203 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 0x7f1980173b60 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=1634434801927550617 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f197400aa70 tx=0x7f197402fde0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.757 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/231776203 shutdown_connections 2026-02-13T03:50:26.757 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/231776203 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 0x7f1980173b60 unknown :-1 s=CLOSED pgs=487 gs=1 cs=0 l=1 c_cookie=1634434801927550617 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/231776203 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f198010d9a0 0x7f19801129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/231776203 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f198010cfb0 0x7f198010d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/231776203 >> 10.20.193.70:0/231776203 conn(0x7f19800ea8b0 msgr2=0x7f198010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/231776203 shutdown_connections 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/231776203 wait complete. 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.753+0000 7f1985b9f6c0 1 Processor -- start 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 -- start start 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f198010cfb0 0x7f198011afa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 0x7f198011b4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:26.758 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f19801208a0 0x7f1980120d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f19801212b0 con 0x7f19801131c0 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f1980121420 con 0x7f198010cfb0 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19801215e0 con 0x7f19801208a0 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197effd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 0x7f198011b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197effd6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 0x7f198011b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:55000/0 (socket says 10.20.193.70:55000) 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197effd6c0 1 -- 10.20.193.70:0/2744785741 learned_addr learned my addr 10.20.193.70:0/2744785741 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197f7fe6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f198010cfb0 0x7f198011afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197ffff6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f19801208a0 0x7f1980120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197effd6c0 1 -- 10.20.193.70:0/2744785741 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f19801208a0 msgr2=0x7f1980120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197effd6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f19801208a0 0x7f1980120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197effd6c0 1 -- 10.20.193.70:0/2744785741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f198010cfb0 msgr2=0x7f198011afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:26.759 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197effd6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f198010cfb0 0x7f198011afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.760 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197effd6c0 1 -- 10.20.193.70:0/2744785741 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197400a660 con 0x7f19801131c0 2026-02-13T03:50:26.760 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197effd6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 0x7f198011b4e0 secure :-1 s=READY pgs=488 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1970005dc0 tx=0x7f197000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:26.760 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197cff96c0 1 -- 10.20.193.70:0/2744785741 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1970004250 con 0x7f19801131c0 2026-02-13T03:50:26.760 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1980161a90 con 0x7f19801131c0 2026-02-13T03:50:26.760 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197cff96c0 1 -- 10.20.193.70:0/2744785741 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1970009070 con 0x7f19801131c0 2026-02-13T03:50:26.760 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f197cff96c0 1 -- 10.20.193.70:0/2744785741 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f197000cd50 con 0x7f19801131c0 2026-02-13T03:50:26.760 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1980161f70 con 0x7f19801131c0 2026-02-13T03:50:26.760 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.754+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f198010e280 con 0x7f19801131c0 2026-02-13T03:50:26.761 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.756+0000 7f197cff96c0 1 -- 10.20.193.70:0/2744785741 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f19700028c0 con 0x7f19801131c0 2026-02-13T03:50:26.762 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.757+0000 7f197cff96c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19540b5680 0x7f19540d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:26.762 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.757+0000 7f197f7fe6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19540b5680 0x7f19540d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:26.762 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.757+0000 7f197cff96c0 1 -- 10.20.193.70:0/2744785741 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f19700e39f0 con 0x7f19801131c0 2026-02-13T03:50:26.762 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.757+0000 7f197cff96c0 1 -- 10.20.193.70:0/2744785741 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f197011c5e0 con 0x7f19801131c0 2026-02-13T03:50:26.762 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.757+0000 7f197f7fe6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19540b5680 0x7f19540d5b30 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f196c005dc0 tx=0x7f196c005d10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:26.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.875+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f198010d380 con 0x7f19801131c0 2026-02-13T03:50:26.877 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:26 trial070 ceph-mon[24757]: pgmap v344: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:26.877 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.875+0000 7f197cff96c0 1 -- 10.20.193.70:0/2744785741 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f19700a6470 con 0x7f19801131c0 2026-02-13T03:50:26.878 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:26.878 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:26.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19540b5680 msgr2=0x7f19540d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:26.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19540b5680 0x7f19540d5b30 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f196c005dc0 tx=0x7f196c005d10 comp rx=0 tx=0).stop 2026-02-13T03:50:26.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 msgr2=0x7f198011b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:26.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 0x7f198011b4e0 secure :-1 s=READY pgs=488 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1970005dc0 tx=0x7f197000bbb0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 shutdown_connections 2026-02-13T03:50:26.879 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f19540b5680 0x7f19540d5b30 unknown :-1 s=CLOSED pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f19801208a0 0x7f1980120d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f19801131c0 0x7f198011b4e0 unknown :-1 s=CLOSED pgs=488 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 --2- 10.20.193.70:0/2744785741 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f198010cfb0 0x7f198011afa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:26.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 >> 10.20.193.70:0/2744785741 conn(0x7f19800ea8b0 msgr2=0x7f198010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:26.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 shutdown_connections 2026-02-13T03:50:26.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:26.876+0000 7f1985b9f6c0 1 -- 10.20.193.70:0/2744785741 wait complete. 2026-02-13T03:50:26.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:26 trial177 ceph-mon[27082]: pgmap v344: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:26.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:26 trial127 ceph-mon[26439]: pgmap v344: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 2 op/s 2026-02-13T03:50:27.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:27 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2744785741' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:27.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:27 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:50:27.973 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:27 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2744785741' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:27.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:27 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:50:28.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:27 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2744785741' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:28.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:27 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:50:28.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:28 trial177 ceph-mon[27082]: pgmap v345: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:28.951 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:50:28.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:50:28.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:50:28.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:28 trial177 ceph-mon[27082]: pgmap v346: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 981 B/s rd, 1 op/s 2026-02-13T03:50:28.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:50:28.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:50:28.952 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:28 trial177 ceph-mon[27082]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:50:28.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:28 trial127 ceph-mon[26439]: pgmap v345: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:28.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:50:28.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:50:28.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:50:28.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:28 trial127 ceph-mon[26439]: pgmap v346: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 981 B/s rd, 1 op/s 2026-02-13T03:50:28.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:50:28.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:50:28.974 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:28 trial127 ceph-mon[26439]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:50:29.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:28 trial070 ceph-mon[24757]: pgmap v345: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 853 B/s rd, 1 op/s 2026-02-13T03:50:29.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:50:29.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:50:29.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' 2026-02-13T03:50:29.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:28 trial070 ceph-mon[24757]: pgmap v346: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 981 B/s rd, 1 op/s 2026-02-13T03:50:29.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:50:29.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:50:29.048 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:28 trial070 ceph-mon[24757]: from='mgr.14116 10.20.193.70:0/580782726' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:50:29.919 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:30.035 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:30.157 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.153+0000 7f0bd39206c0 1 -- 10.20.193.70:0/462327905 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10fc20 msgr2=0x7f0bcc114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.153+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/462327905 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10fc20 0x7f0bcc114c60 secure :-1 s=READY pgs=489 gs=1 cs=0 l=1 c_cookie=16320880099963669600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bc00099a0 tx=0x7f0bc002ed20 comp rx=0 tx=0).stop 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.153+0000 7f0bd39206c0 1 -- 10.20.193.70:0/462327905 shutdown_connections 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.153+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/462327905 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0bcc115440 0x7f0bcc175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.153+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/462327905 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10fc20 0x7f0bcc114c60 unknown :-1 s=CLOSED pgs=489 gs=1 cs=0 l=1 c_cookie=16320880099963669600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.153+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/462327905 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bcc10f230 0x7f0bcc10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.153+0000 7f0bd39206c0 1 -- 10.20.193.70:0/462327905 >> 10.20.193.70:0/462327905 conn(0x7f0bcc0ecb30 msgr2=0x7f0bcc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.153+0000 7f0bd39206c0 1 -- 10.20.193.70:0/462327905 shutdown_connections 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.153+0000 7f0bd39206c0 1 -- 10.20.193.70:0/462327905 wait complete. 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 Processor -- start 2026-02-13T03:50:30.158 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 -- start start 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10f230 0x7f0bcc0f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0bcc115440 0x7f0bcc175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bcc0f52c0 0x7f0bcc0fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc0f59b0 con 0x7f0bcc10f230 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc0faa80 con 0x7f0bcc115440 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc0fac40 con 0x7f0bcc0f52c0 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd16956c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10f230 0x7f0bcc0f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd16956c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10f230 0x7f0bcc0f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:55026/0 (socket says 10.20.193.70:55026) 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd16956c0 1 -- 10.20.193.70:0/1705983613 learned_addr learned my addr 10.20.193.70:0/1705983613 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd1e966c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bcc0f52c0 0x7f0bcc0fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd16956c0 1 -- 10.20.193.70:0/1705983613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bcc0f52c0 msgr2=0x7f0bcc0fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:30.159 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd16956c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bcc0f52c0 0x7f0bcc0fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd16956c0 1 -- 10.20.193.70:0/1705983613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0bcc115440 msgr2=0x7f0bcc175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd16956c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0bcc115440 0x7f0bcc175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd16956c0 1 -- 10.20.193.70:0/1705983613 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc0009590 con 0x7f0bcc10f230 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd16956c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10f230 0x7f0bcc0f4c90 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bbc005dc0 tx=0x7f0bbc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bba7fc6c0 1 -- 10.20.193.70:0/1705983613 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0bbc004240 con 0x7f0bcc10f230 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bcc0faf20 con 0x7f0bcc10f230 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bba7fc6c0 1 -- 10.20.193.70:0/1705983613 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0bbc0043a0 con 0x7f0bcc10f230 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bba7fc6c0 1 -- 10.20.193.70:0/1705983613 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0bbc00ccb0 con 0x7f0bcc10f230 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.154+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bcc0fb6b0 con 0x7f0bcc10f230 2026-02-13T03:50:30.160 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.155+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bcc110500 con 0x7f0bcc10f230 2026-02-13T03:50:30.161 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.156+0000 7f0bba7fc6c0 1 -- 10.20.193.70:0/1705983613 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f0bbc0026b0 con 0x7f0bcc10f230 2026-02-13T03:50:30.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.157+0000 7f0bba7fc6c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ba80b5600 0x7f0ba80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:30.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.157+0000 7f0bba7fc6c0 1 -- 10.20.193.70:0/1705983613 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f0bbc0e3ac0 con 0x7f0bcc10f230 2026-02-13T03:50:30.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.157+0000 7f0bd0e946c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ba80b5600 0x7f0ba80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:30.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.157+0000 7f0bba7fc6c0 1 -- 10.20.193.70:0/1705983613 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0bbc0a6540 con 0x7f0bcc10f230 2026-02-13T03:50:30.162 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.157+0000 7f0bd0e946c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ba80b5600 0x7f0ba80d5ab0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bc00098c0 tx=0x7f0bc0005c20 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:30.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:29 trial177 ceph-mon[27082]: pgmap v347: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 567 B/s rd, 1 op/s 2026-02-13T03:50:30.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:29 trial127 ceph-mon[26439]: pgmap v347: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 567 B/s rd, 1 op/s 2026-02-13T03:50:30.279 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.277+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0bcc0f5d90 con 0x7f0bcc10f230 2026-02-13T03:50:30.280 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:29 trial070 ceph-mon[24757]: pgmap v347: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 567 B/s rd, 1 op/s 2026-02-13T03:50:30.280 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.278+0000 7f0bba7fc6c0 1 -- 10.20.193.70:0/1705983613 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0bbc0a96f0 con 0x7f0bcc10f230 2026-02-13T03:50:30.281 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:30.281 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:30.282 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ba80b5600 msgr2=0x7f0ba80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:30.282 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ba80b5600 0x7f0ba80d5ab0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bc00098c0 tx=0x7f0bc0005c20 comp rx=0 tx=0).stop 2026-02-13T03:50:30.282 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10f230 msgr2=0x7f0bcc0f4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:30.282 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10f230 0x7f0bcc0f4c90 secure :-1 s=READY pgs=490 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bbc005dc0 tx=0x7f0bbc00bbb0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.282 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 shutdown_connections 2026-02-13T03:50:30.282 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f0ba80b5600 0x7f0ba80d5ab0 unknown :-1 s=CLOSED pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.282 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bcc0f52c0 0x7f0bcc0fa540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.282 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f0bcc115440 0x7f0bcc175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.283 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 --2- 10.20.193.70:0/1705983613 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f0bcc10f230 0x7f0bcc0f4c90 unknown :-1 s=CLOSED pgs=490 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:30.283 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 >> 10.20.193.70:0/1705983613 conn(0x7f0bcc0ecb30 msgr2=0x7f0bcc10d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:30.283 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 shutdown_connections 2026-02-13T03:50:30.283 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:30.279+0000 7f0bd39206c0 1 -- 10.20.193.70:0/1705983613 wait complete. 2026-02-13T03:50:31.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:30 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/1705983613' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:31.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:30 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/1705983613' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:31.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:30 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/1705983613' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:32.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:31 trial177 ceph-mon[27082]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:50:32.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:31 trial127 ceph-mon[26439]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:50:32.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:31 trial070 ceph-mon[24757]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:50:33.323 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:33.441 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:33.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 -- 10.20.193.70:0/699458727 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0115440 msgr2=0x7f79d0175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:33.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/699458727 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0115440 0x7f79d0175de0 secure :-1 s=READY pgs=491 gs=1 cs=0 l=1 c_cookie=11584194406695755474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79cc00aa70 tx=0x7f79cc02fde0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.558 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 -- 10.20.193.70:0/699458727 shutdown_connections 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/699458727 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0115440 0x7f79d0175de0 unknown :-1 s=CLOSED pgs=491 gs=1 cs=0 l=1 c_cookie=11584194406695755474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/699458727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f79d010fc20 0x7f79d0114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/699458727 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79d010f230 0x7f79d010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 -- 10.20.193.70:0/699458727 >> 10.20.193.70:0/699458727 conn(0x7f79d00ecb30 msgr2=0x7f79d010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 -- 10.20.193.70:0/699458727 shutdown_connections 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 -- 10.20.193.70:0/699458727 wait complete. 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 Processor -- start 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.554+0000 7f79d86e86c0 1 -- start start 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d86e86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f79d010f230 0x7f79d011d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:33.559 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d86e86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79d0115440 0x7f79d011d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d86e86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0122ae0 0x7f79d0122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d86e86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79d01234f0 con 0x7f79d0122ae0 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d86e86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0123660 con 0x7f79d0115440 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d86e86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f79d0123820 con 0x7f79d010f230 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d6c5a6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0122ae0 0x7f79d0122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d6c5a6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0122ae0 0x7f79d0122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:55032/0 (socket says 10.20.193.70:55032) 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d6c5a6c0 1 -- 10.20.193.70:0/2048900415 learned_addr learned my addr 10.20.193.70:0/2048900415 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d5c586c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79d0115440 0x7f79d011d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d6c5a6c0 1 -- 10.20.193.70:0/2048900415 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f79d010f230 msgr2=0x7f79d011d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d6c5a6c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f79d010f230 0x7f79d011d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d6c5a6c0 1 -- 10.20.193.70:0/2048900415 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79d0115440 msgr2=0x7f79d011d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:33.560 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d6c5a6c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79d0115440 0x7f79d011d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d6c5a6c0 1 -- 10.20.193.70:0/2048900415 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc00a660 con 0x7f79d0122ae0 2026-02-13T03:50:33.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d6c5a6c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0122ae0 0x7f79d0122f80 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79cc0054b0 tx=0x7f79cc0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:33.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79b77fe6c0 1 -- 10.20.193.70:0/2048900415 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79cc003a30 con 0x7f79d0122ae0 2026-02-13T03:50:33.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d0163c70 con 0x7f79d0122ae0 2026-02-13T03:50:33.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79b77fe6c0 1 -- 10.20.193.70:0/2048900415 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f79cc003b90 con 0x7f79d0122ae0 2026-02-13T03:50:33.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79b77fe6c0 1 -- 10.20.193.70:0/2048900415 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79cc0382f0 con 0x7f79d0122ae0 2026-02-13T03:50:33.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d01640a0 con 0x7f79d0122ae0 2026-02-13T03:50:33.561 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.555+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d0110500 con 0x7f79d0122ae0 2026-02-13T03:50:33.562 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.557+0000 7f79b77fe6c0 1 -- 10.20.193.70:0/2048900415 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7f79cc008260 con 0x7f79d0122ae0 2026-02-13T03:50:33.562 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.558+0000 7f79b77fe6c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79ac0b5600 0x7f79ac0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:33.562 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.558+0000 7f79d64596c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79ac0b5600 0x7f79ac0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:33.562 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.558+0000 7f79b77fe6c0 1 -- 10.20.193.70:0/2048900415 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7f79cc108e90 con 0x7f79d0122ae0 2026-02-13T03:50:33.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.558+0000 7f79b77fe6c0 1 -- 10.20.193.70:0/2048900415 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f79cc109380 con 0x7f79d0122ae0 2026-02-13T03:50:33.563 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.558+0000 7f79d64596c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79ac0b5600 0x7f79ac0d5ab0 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c0005980 tx=0x7f79c0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:33.679 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.677+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f79d011e330 con 0x7f79d0122ae0 2026-02-13T03:50:33.679 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.677+0000 7f79b77fe6c0 1 -- 10.20.193.70:0/2048900415 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f79cc0cb950 con 0x7f79d0122ae0 2026-02-13T03:50:33.679 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:33.680 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:33.680 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79ac0b5600 msgr2=0x7f79ac0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79ac0b5600 0x7f79ac0d5ab0 secure :-1 s=READY pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c0005980 tx=0x7f79c0005910 comp rx=0 tx=0).stop 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0122ae0 msgr2=0x7f79d0122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0122ae0 0x7f79d0122f80 secure :-1 s=READY pgs=492 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79cc0054b0 tx=0x7f79cc0054e0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 shutdown_connections 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7f79ac0b5600 0x7f79ac0d5ab0 unknown :-1 s=CLOSED pgs=313 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7f79d0122ae0 0x7f79d0122f80 unknown :-1 s=CLOSED pgs=492 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7f79d0115440 0x7f79d011d720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 --2- 10.20.193.70:0/2048900415 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f79d010f230 0x7f79d011d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 >> 10.20.193.70:0/2048900415 conn(0x7f79d00ecb30 msgr2=0x7f79d010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 shutdown_connections 2026-02-13T03:50:33.681 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:33.678+0000 7f79d86e86c0 1 -- 10.20.193.70:0/2048900415 wait complete. 2026-02-13T03:50:34.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:33 trial070 ceph-mon[24757]: pgmap v349: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:50:34.047 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:33 trial070 ceph-mon[24757]: from='client.? 10.20.193.70:0/2048900415' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:34.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:33 trial177 ceph-mon[27082]: pgmap v349: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:50:34.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:33 trial177 ceph-mon[27082]: from='client.? 10.20.193.70:0/2048900415' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:33 trial127 ceph-mon[26439]: pgmap v349: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:50:34.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:33 trial127 ceph-mon[26439]: from='client.? 10.20.193.70:0/2048900415' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T03:50:36.201 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:35 trial177 ceph-mon[27082]: pgmap v350: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:50:36.223 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:35 trial127 ceph-mon[26439]: pgmap v350: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:50:36.297 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:35 trial070 ceph-mon[24757]: pgmap v350: 97 pgs: 97 active+clean; 645 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 2 op/s 2026-02-13T03:50:36.722 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph health --format=json 2026-02-13T03:50:36.842 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:36.964 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.960+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/2025000083 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a0115440 msgr2=0x7ff5a0175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.960+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/2025000083 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a0115440 0x7ff5a0175de0 secure :-1 s=READY pgs=493 gs=1 cs=0 l=1 c_cookie=448276312010671828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff59c00aa70 tx=0x7ff59c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.960+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/2025000083 shutdown_connections 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.960+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/2025000083 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a0115440 0x7ff5a0175de0 unknown :-1 s=CLOSED pgs=493 gs=1 cs=0 l=1 c_cookie=448276312010671828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.960+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/2025000083 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff5a010fc20 0x7ff5a0114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.960+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/2025000083 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5a010f230 0x7ff5a010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.960+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/2025000083 >> 10.20.193.70:0/2025000083 conn(0x7ff5a00ecb30 msgr2=0x7ff5a010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.960+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/2025000083 shutdown_connections 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.960+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/2025000083 wait complete. 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 Processor -- start 2026-02-13T03:50:36.965 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 -- start start 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a010f230 0x7ff5a011d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff5a0115440 0x7ff5a011d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 --2- >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5a0122b00 0x7ff5a0122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 -- --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0123510 con 0x7ff5a010f230 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 -- --> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0123680 con 0x7ff5a0122b00 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a0123840 con 0x7ff5a0115440 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a4b3d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a010f230 0x7ff5a011d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a4b3d6c0 1 --2- >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a010f230 0x7ff5a011d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.70:3300/0 says I am v2:10.20.193.70:42404/0 (socket says 10.20.193.70:42404) 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a4b3d6c0 1 -- 10.20.193.70:0/3396695331 learned_addr learned my addr 10.20.193.70:0/3396695331 (peer_addr_for_me v2:10.20.193.70:0/0) 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a533e6c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5a0122b00 0x7ff5a0122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:36.966 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff597fff6c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff5a0115440 0x7ff5a011d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a4b3d6c0 1 -- 10.20.193.70:0/3396695331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff5a0115440 msgr2=0x7ff5a011d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a4b3d6c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff5a0115440 0x7ff5a011d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a4b3d6c0 1 -- 10.20.193.70:0/3396695331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5a0122b00 msgr2=0x7ff5a0122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a4b3d6c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5a0122b00 0x7ff5a0122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a4b3d6c0 1 -- 10.20.193.70:0/3396695331 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c00a660 con 0x7ff5a010f230 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff597fff6c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff5a0115440 0x7ff5a011d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a4b3d6c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a010f230 0x7ff5a011d200 secure :-1 s=READY pgs=494 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff59000b710 tx=0x7ff59000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff595ffb6c0 1 -- 10.20.193.70:0/3396695331 <== mon.0 v2:10.20.193.70:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff590004250 con 0x7ff5a010f230 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff595ffb6c0 1 -- 10.20.193.70:0/3396695331 <== mon.0 v2:10.20.193.70:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff590002d80 con 0x7ff5a010f230 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff595ffb6c0 1 -- 10.20.193.70:0/3396695331 <== mon.0 v2:10.20.193.70:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff59000cdc0 con 0x7ff5a010f230 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a0163cf0 con 0x7ff5a010f230 2026-02-13T03:50:36.967 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.961+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a01641d0 con 0x7ff5a010f230 2026-02-13T03:50:36.968 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.962+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a0110500 con 0x7ff5a010f230 2026-02-13T03:50:36.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.963+0000 7ff595ffb6c0 1 -- 10.20.193.70:0/3396695331 <== mon.0 v2:10.20.193.70:3300/0 4 ==== mgrmap(e 13) ==== 157066+0+0 (secure 0 0 0) 0x7ff5900028c0 con 0x7ff5a010f230 2026-02-13T03:50:36.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.964+0000 7ff595ffb6c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff57c0b5680 0x7ff57c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:50:36.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.964+0000 7ff597fff6c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff57c0b5680 0x7ff57c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:50:36.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.964+0000 7ff595ffb6c0 1 -- 10.20.193.70:0/3396695331 <== mon.0 v2:10.20.193.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 8023+0+0 (secure 0 0 0) 0x7ff5900e3b50 con 0x7ff5a010f230 2026-02-13T03:50:36.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.964+0000 7ff595ffb6c0 1 -- 10.20.193.70:0/3396695331 <== mon.0 v2:10.20.193.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff5900a6610 con 0x7ff5a010f230 2026-02-13T03:50:36.969 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:36.964+0000 7ff597fff6c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff57c0b5680 0x7ff57c0d5b30 secure :-1 s=READY pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5a0123b90 tx=0x7ff588005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:50:37.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.083+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 --> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff5a010f600 con 0x7ff5a010f230 2026-02-13T03:50:37.085 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.083+0000 7ff595ffb6c0 1 -- 10.20.193.70:0/3396695331 <== mon.0 v2:10.20.193.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff5900a97c0 con 0x7ff5a010f230 2026-02-13T03:50:37.085 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-13T03:50:37.085 INFO:teuthology.orchestra.run.trial070.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T03:50:37.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff57c0b5680 msgr2=0x7ff57c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:37.086 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff57c0b5680 0x7ff57c0d5b30 secure :-1 s=READY pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5a0123b90 tx=0x7ff588005f10 comp rx=0 tx=0).stop 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a010f230 msgr2=0x7ff5a011d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a010f230 0x7ff5a011d200 secure :-1 s=READY pgs=494 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff59000b710 tx=0x7ff59000bbe0 comp rx=0 tx=0).stop 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 shutdown_connections 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:6800/1747996128,v1:10.20.193.70:6801/1747996128] conn(0x7ff57c0b5680 0x7ff57c0d5b30 unknown :-1 s=CLOSED pgs=314 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.127:3300/0,v1:10.20.193.127:6789/0] conn(0x7ff5a0122b00 0x7ff5a0122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff5a0115440 0x7ff5a011d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 --2- 10.20.193.70:0/3396695331 >> [v2:10.20.193.70:3300/0,v1:10.20.193.70:6789/0] conn(0x7ff5a010f230 0x7ff5a011d200 unknown :-1 s=CLOSED pgs=494 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 >> 10.20.193.70:0/3396695331 conn(0x7ff5a00ecb30 msgr2=0x7ff5a010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 shutdown_connections 2026-02-13T03:50:37.087 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-13T03:50:37.084+0000 7ff5a6dc86c0 1 -- 10.20.193.70:0/3396695331 wait complete. 2026-02-13T03:50:37.126 INFO:tasks.cephadm:Teardown begin 2026-02-13T03:50:37.127 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T03:50:37.131 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:50:37.157 DEBUG:teuthology.orchestra.run.trial127:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:50:37.185 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:50:37.216 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-13T03:50:37.216 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-13T03:50:37.332 INFO:teuthology.orchestra.run.trial070.stderr:Inferring config /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/mon.a/config 2026-02-13T03:50:37.350 INFO:teuthology.orchestra.run.trial070.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-13T03:50:37.368 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-13T03:50:37.369 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-13T03:50:37.369 DEBUG:teuthology.orchestra.run.trial070:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T03:50:37.385 DEBUG:teuthology.orchestra.run.trial127:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T03:50:37.402 DEBUG:teuthology.orchestra.run.trial177:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T03:50:37.420 INFO:tasks.cephadm:Stopping all daemons... 2026-02-13T03:50:37.421 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-13T03:50:37.421 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.a 2026-02-13T03:50:37.621 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:37 trial070 systemd[1]: Stopping Ceph mon.a for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:50:37.622 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:37 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a[24753]: 2026-02-13T03:50:37.529+0000 7f280a4026c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:50:37.622 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:37 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a[24753]: 2026-02-13T03:50:37.529+0000 7f280a4026c0 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-13T03:50:37.622 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:37 trial070 podman[80153]: 2026-02-13 03:50:37.551385505 +0000 UTC m=+0.033322485 container died 8c0222b189f3a09516b07382ebc623bba7cc68ed432f300ae57605d6f4135a5d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, version=10, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7) 2026-02-13T03:50:37.622 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:37 trial070 podman[80153]: 2026-02-13 03:50:37.56051935 +0000 UTC m=+0.042456340 container remove 8c0222b189f3a09516b07382ebc623bba7cc68ed432f300ae57605d6f4135a5d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, license=BSD-3-Clause, ceph=True, version=10) 2026-02-13T03:50:37.622 INFO:journalctl@ceph.mon.a.trial070.stdout:Feb 13 03:50:37 trial070 bash[80153]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-a 2026-02-13T03:50:37.642 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.a.service' 2026-02-13T03:50:37.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:50:37.682 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-13T03:50:37.682 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-13T03:50:37.682 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.b 2026-02-13T03:50:37.965 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:37 trial127 systemd[1]: Stopping Ceph mon.b for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:50:37.965 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:37 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-b[26435]: 2026-02-13T03:50:37.782+0000 7f8bc25dc6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:50:37.965 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:37 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-b[26435]: 2026-02-13T03:50:37.782+0000 7f8bc25dc6c0 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-13T03:50:37.965 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:37 trial127 podman[57661]: 2026-02-13 03:50:37.935256505 +0000 UTC m=+0.165256385 container died 4e902bcde8cccd6082323e9d53c8383ccf15c9e7fcfd93d2c33e1b9a0e730865 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-b, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:50:37.965 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:37 trial127 podman[57661]: 2026-02-13 03:50:37.944476629 +0000 UTC m=+0.174476509 container remove 4e902bcde8cccd6082323e9d53c8383ccf15c9e7fcfd93d2c33e1b9a0e730865 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-b, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, name=rockylinux, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T03:50:37.965 INFO:journalctl@ceph.mon.b.trial127.stdout:Feb 13 03:50:37 trial127 bash[57661]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-b 2026-02-13T03:50:38.016 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.b.service' 2026-02-13T03:50:38.055 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:50:38.056 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-13T03:50:38.056 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-13T03:50:38.056 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.c 2026-02-13T03:50:38.332 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:38 trial177 systemd[1]: Stopping Ceph mon.c for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:50:38.332 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:38 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-c[27075]: 2026-02-13T03:50:38.158+0000 7fbaba9756c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:50:38.332 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 13 03:50:38 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mon-c[27075]: 2026-02-13T03:50:38.158+0000 7fbaba9756c0 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-13T03:50:38.420 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mon.c.service' 2026-02-13T03:50:38.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:50:38.458 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-13T03:50:38.458 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-13T03:50:38.458 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.x 2026-02-13T03:50:38.678 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.x.service' 2026-02-13T03:50:38.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:50:38.713 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-13T03:50:38.713 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-13T03:50:38.714 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.y 2026-02-13T03:50:38.825 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:50:38 trial127 systemd[1]: Stopping Ceph mgr.y for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:50:38.826 INFO:journalctl@ceph.mgr.y.trial127.stdout:Feb 13 03:50:38 trial127 podman[57824]: 2026-02-13 03:50:38.81966259 +0000 UTC m=+0.023469202 container died b2f353fb53be698c96bb43e5b2ed65f90c065256225f97a3c9980ea5c09e0d43 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mgr-y, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image) 2026-02-13T03:50:38.898 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.y.service' 2026-02-13T03:50:38.932 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:50:38.932 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-13T03:50:38.932 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-13T03:50:38.933 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.z 2026-02-13T03:50:39.160 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mgr.z.service' 2026-02-13T03:50:39.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:50:39.195 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-13T03:50:39.196 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-13T03:50:39.196 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.0 2026-02-13T03:50:39.547 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:39 trial070 systemd[1]: Stopping Ceph osd.0 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:50:39.548 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:39 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0[37197]: 2026-02-13T03:50:39.292+0000 7ff17aa996c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:50:39.548 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:39 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0[37197]: 2026-02-13T03:50:39.292+0000 7ff17aa996c0 -1 osd.0 72 *** Got signal Terminated *** 2026-02-13T03:50:39.548 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:39 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0[37197]: 2026-02-13T03:50:39.292+0000 7ff17aa996c0 -1 osd.0 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:50:44.647 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:44 trial070 podman[80475]: 2026-02-13 03:50:44.353110797 +0000 UTC m=+5.072307070 container died 76c07ad4a38217ce67fc961c565258f5ccf95918b3a7b4d0170f8b23ffb95c96 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10) 2026-02-13T03:50:44.648 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:44 trial070 podman[80475]: 2026-02-13 03:50:44.362240504 +0000 UTC m=+5.081436787 container remove 76c07ad4a38217ce67fc961c565258f5ccf95918b3a7b4d0170f8b23ffb95c96 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, version=10, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10) 2026-02-13T03:50:44.648 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:44 trial070 bash[80475]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0 2026-02-13T03:50:44.648 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:44 trial070 podman[80603]: 2026-02-13 03:50:44.494769814 +0000 UTC m=+0.015995359 container create fce93a37e34f540d7d33a9a89af77d07856c94d639ef31fa65021c39197c2175 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.version=10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:50:44.648 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:44 trial070 podman[80603]: 2026-02-13 03:50:44.52309358 +0000 UTC m=+0.044319135 container init fce93a37e34f540d7d33a9a89af77d07856c94d639ef31fa65021c39197c2175 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:50:44.648 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:44 trial070 podman[80603]: 2026-02-13 03:50:44.525649855 +0000 UTC m=+0.046875420 container start fce93a37e34f540d7d33a9a89af77d07856c94d639ef31fa65021c39197c2175 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0-deactivate, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, version=10, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T03:50:44.648 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:44 trial070 podman[80603]: 2026-02-13 03:50:44.526202582 +0000 UTC m=+0.047428137 container attach fce93a37e34f540d7d33a9a89af77d07856c94d639ef31fa65021c39197c2175 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0-deactivate, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause) 2026-02-13T03:50:44.648 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:44 trial070 podman[80603]: 2026-02-13 03:50:44.488540437 +0000 UTC m=+0.009766002 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:50:44.648 INFO:journalctl@ceph.osd.0.trial070.stdout:Feb 13 03:50:44 trial070 podman[80603]: 2026-02-13 03:50:44.646184021 +0000 UTC m=+0.167409576 container died fce93a37e34f540d7d33a9a89af77d07856c94d639ef31fa65021c39197c2175 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-0-deactivate, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, OSD_FLAVOR=default, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7) 2026-02-13T03:50:44.683 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.0.service' 2026-02-13T03:50:44.720 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:50:44.720 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-13T03:50:44.720 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-13T03:50:44.721 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.1 2026-02-13T03:50:45.224 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:44 trial127 systemd[1]: Stopping Ceph osd.1 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:50:45.224 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:44 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1[31266]: 2026-02-13T03:50:44.822+0000 7f9d5bc8b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:50:45.224 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:44 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1[31266]: 2026-02-13T03:50:44.822+0000 7f9d5bc8b6c0 -1 osd.1 72 *** Got signal Terminated *** 2026-02-13T03:50:45.224 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:44 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1[31266]: 2026-02-13T03:50:44.822+0000 7f9d5bc8b6c0 -1 osd.1 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:50:50.194 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:49 trial127 podman[57978]: 2026-02-13 03:50:49.892522524 +0000 UTC m=+5.081949031 container died 693c5d46a63b1bbec8755178090a138518f623151b9c234741e483c1b2d60002 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T03:50:50.194 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:49 trial127 podman[57978]: 2026-02-13 03:50:49.90122758 +0000 UTC m=+5.090654097 container remove 693c5d46a63b1bbec8755178090a138518f623151b9c234741e483c1b2d60002 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, license=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux) 2026-02-13T03:50:50.194 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:49 trial127 bash[57978]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1 2026-02-13T03:50:50.194 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:50 trial127 podman[58118]: 2026-02-13 03:50:50.038196674 +0000 UTC m=+0.016148293 container create cad2f02af55d7bd38a0d4080e985fff48e9dc61a35446d385bf4b2debdf118d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=default, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:50:50.194 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:50 trial127 podman[58118]: 2026-02-13 03:50:50.068853525 +0000 UTC m=+0.046805084 container init cad2f02af55d7bd38a0d4080e985fff48e9dc61a35446d385bf4b2debdf118d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.version=10, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, name=rockylinux) 2026-02-13T03:50:50.194 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:50 trial127 podman[58118]: 2026-02-13 03:50:50.071331178 +0000 UTC m=+0.049282737 container start cad2f02af55d7bd38a0d4080e985fff48e9dc61a35446d385bf4b2debdf118d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.version=10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, version=10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T03:50:50.194 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:50 trial127 podman[58118]: 2026-02-13 03:50:50.071840375 +0000 UTC m=+0.049791934 container attach cad2f02af55d7bd38a0d4080e985fff48e9dc61a35446d385bf4b2debdf118d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, io.buildah.version=1.33.7, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T03:50:50.195 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:50 trial127 podman[58118]: 2026-02-13 03:50:50.03189873 +0000 UTC m=+0.009850299 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:50:50.195 INFO:journalctl@ceph.osd.1.trial127.stdout:Feb 13 03:50:50 trial127 podman[58118]: 2026-02-13 03:50:50.192972697 +0000 UTC m=+0.170924256 container died cad2f02af55d7bd38a0d4080e985fff48e9dc61a35446d385bf4b2debdf118d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, name=rockylinux, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:50:50.234 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.1.service' 2026-02-13T03:50:50.271 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:50:50.271 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-13T03:50:50.271 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-13T03:50:50.272 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.2 2026-02-13T03:50:50.701 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:50 trial177 systemd[1]: Stopping Ceph osd.2 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:50:50.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:50 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2[32309]: 2026-02-13T03:50:50.370+0000 7fd2121976c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:50:50.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:50 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2[32309]: 2026-02-13T03:50:50.370+0000 7fd2121976c0 -1 osd.2 72 *** Got signal Terminated *** 2026-02-13T03:50:50.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:50 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2[32309]: 2026-02-13T03:50:50.370+0000 7fd2121976c0 -1 osd.2 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:50:55.701 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:55 trial177 podman[59993]: 2026-02-13 03:50:55.440586226 +0000 UTC m=+5.081628723 container died bfedfa514ddc40f2685a2cbd75e5b0819912fdc1d96ed436652875401137238f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7) 2026-02-13T03:50:55.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:55 trial177 podman[59993]: 2026-02-13 03:50:55.449522731 +0000 UTC m=+5.090565228 container remove bfedfa514ddc40f2685a2cbd75e5b0819912fdc1d96ed436652875401137238f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, version=10, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T03:50:55.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:55 trial177 bash[59993]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2 2026-02-13T03:50:55.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:55 trial177 podman[60121]: 2026-02-13 03:50:55.569702696 +0000 UTC m=+0.016162313 container create 03874f3e6ecee3cbf994c1a9afe70c68089645578387d236357bf62fa54c7418 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T03:50:55.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:55 trial177 podman[60121]: 2026-02-13 03:50:55.59572516 +0000 UTC m=+0.042184787 container init 03874f3e6ecee3cbf994c1a9afe70c68089645578387d236357bf62fa54c7418 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T03:50:55.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:55 trial177 podman[60121]: 2026-02-13 03:50:55.598145117 +0000 UTC m=+0.044604734 container start 03874f3e6ecee3cbf994c1a9afe70c68089645578387d236357bf62fa54c7418 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.opencontainers.image.version=10) 2026-02-13T03:50:55.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:55 trial177 podman[60121]: 2026-02-13 03:50:55.598580716 +0000 UTC m=+0.045040343 container attach 03874f3e6ecee3cbf994c1a9afe70c68089645578387d236357bf62fa54c7418 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, summary=Rocky Linux Base image, version=10, io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T03:50:55.702 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 13 03:50:55 trial177 podman[60121]: 2026-02-13 03:50:55.563250316 +0000 UTC m=+0.009709933 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:50:55.763 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.2.service' 2026-02-13T03:50:55.798 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:50:55.799 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-13T03:50:55.799 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-13T03:50:55.799 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.3 2026-02-13T03:50:56.297 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:50:55 trial070 systemd[1]: Stopping Ceph osd.3 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:50:56.298 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:50:55 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3[43455]: 2026-02-13T03:50:55.895+0000 7f35725756c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:50:56.298 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:50:55 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3[43455]: 2026-02-13T03:50:55.895+0000 7f35725756c0 -1 osd.3 72 *** Got signal Terminated *** 2026-02-13T03:50:56.298 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:50:55 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3[43455]: 2026-02-13T03:50:55.895+0000 7f35725756c0 -1 osd.3 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:51:01.282 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:51:00 trial070 podman[80740]: 2026-02-13 03:51:00.955764963 +0000 UTC m=+5.072785457 container died 6b2703f5fd476ab1f5512063a364df5abb9297d2393269de92d18c253560f80a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, version=10, ceph=True, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:51:01.282 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:51:00 trial070 podman[80740]: 2026-02-13 03:51:00.965509404 +0000 UTC m=+5.082529908 container remove 6b2703f5fd476ab1f5512063a364df5abb9297d2393269de92d18c253560f80a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:51:01.283 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:51:00 trial070 bash[80740]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3 2026-02-13T03:51:01.283 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:51:01 trial070 podman[80880]: 2026-02-13 03:51:01.109756346 +0000 UTC m=+0.016608469 container create fd9bc278275803216080a7f1d2673eb6a1adbd334492121eb25a3ffac43ebff5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, io.buildah.version=1.33.7, license=BSD-3-Clause, ceph=True, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux) 2026-02-13T03:51:01.283 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:51:01 trial070 podman[80880]: 2026-02-13 03:51:01.143140375 +0000 UTC m=+0.049992508 container init fd9bc278275803216080a7f1d2673eb6a1adbd334492121eb25a3ffac43ebff5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , ceph=True, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T03:51:01.283 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:51:01 trial070 podman[80880]: 2026-02-13 03:51:01.145768305 +0000 UTC m=+0.052620428 container start fd9bc278275803216080a7f1d2673eb6a1adbd334492121eb25a3ffac43ebff5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T03:51:01.283 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:51:01 trial070 podman[80880]: 2026-02-13 03:51:01.146278042 +0000 UTC m=+0.053130165 container attach fd9bc278275803216080a7f1d2673eb6a1adbd334492121eb25a3ffac43ebff5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3-deactivate, version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, ceph=True, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:51:01.283 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:51:01 trial070 podman[80880]: 2026-02-13 03:51:01.103024406 +0000 UTC m=+0.009876529 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:51:01.283 INFO:journalctl@ceph.osd.3.trial070.stdout:Feb 13 03:51:01 trial070 podman[80880]: 2026-02-13 03:51:01.280964648 +0000 UTC m=+0.187816761 container died fd9bc278275803216080a7f1d2673eb6a1adbd334492121eb25a3ffac43ebff5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-3-deactivate, ceph=True, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T03:51:01.309 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.3.service' 2026-02-13T03:51:01.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:01.346 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-13T03:51:01.346 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-13T03:51:01.346 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.4 2026-02-13T03:51:01.724 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:01 trial127 systemd[1]: Stopping Ceph osd.4 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:01.724 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:01 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4[37520]: 2026-02-13T03:51:01.446+0000 7fc8b57c66c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:51:01.724 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:01 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4[37520]: 2026-02-13T03:51:01.446+0000 7fc8b57c66c0 -1 osd.4 72 *** Got signal Terminated *** 2026-02-13T03:51:01.724 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:01 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4[37520]: 2026-02-13T03:51:01.446+0000 7fc8b57c66c0 -1 osd.4 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:51:04.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:04 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:04.607+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:05.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:05 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:05.264+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:05.701 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:05 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:05.405+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:05.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:05 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:05.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:06.701 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:06 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:06.436+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:06.791 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:06 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:06.585+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:06.792 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:06 trial127 podman[58251]: 2026-02-13 03:51:06.505092055 +0000 UTC m=+5.071690321 container died d5b4e70f07aa28a4b44403dc2dfc8c1fb48b08569ce38d7bb9357627af60795b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:51:06.792 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:06 trial127 podman[58251]: 2026-02-13 03:51:06.513686324 +0000 UTC m=+5.080284590 container remove d5b4e70f07aa28a4b44403dc2dfc8c1fb48b08569ce38d7bb9357627af60795b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:51:06.792 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:06 trial127 bash[58251]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4 2026-02-13T03:51:06.792 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:06 trial127 podman[58380]: 2026-02-13 03:51:06.642561691 +0000 UTC m=+0.016158923 container create f9fc5f0b37ad884bb0362345e8cab00292f612d85fee000581f6e947d59cf950 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4-deactivate, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7) 2026-02-13T03:51:06.792 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:06 trial127 podman[58380]: 2026-02-13 03:51:06.669376811 +0000 UTC m=+0.042974043 container init f9fc5f0b37ad884bb0362345e8cab00292f612d85fee000581f6e947d59cf950 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux) 2026-02-13T03:51:06.792 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:06 trial127 podman[58380]: 2026-02-13 03:51:06.672133422 +0000 UTC m=+0.045730654 container start f9fc5f0b37ad884bb0362345e8cab00292f612d85fee000581f6e947d59cf950 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.version=10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, name=rockylinux) 2026-02-13T03:51:06.792 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:06 trial127 podman[58380]: 2026-02-13 03:51:06.672704976 +0000 UTC m=+0.046302208 container attach f9fc5f0b37ad884bb0362345e8cab00292f612d85fee000581f6e947d59cf950 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10) 2026-02-13T03:51:06.792 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:06 trial127 podman[58380]: 2026-02-13 03:51:06.635818087 +0000 UTC m=+0.009415319 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:51:06.793 INFO:journalctl@ceph.osd.4.trial127.stdout:Feb 13 03:51:06 trial127 podman[58380]: 2026-02-13 03:51:06.790570297 +0000 UTC m=+0.164167529 container died f9fc5f0b37ad884bb0362345e8cab00292f612d85fee000581f6e947d59cf950 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-4-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, version=10) 2026-02-13T03:51:06.797 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:06 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:06.307+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:06.827 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.4.service' 2026-02-13T03:51:06.863 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:06.864 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-13T03:51:06.864 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-13T03:51:06.864 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.5 2026-02-13T03:51:07.201 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:06 trial177 systemd[1]: Stopping Ceph osd.5 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:07.201 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:06 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5[38505]: 2026-02-13T03:51:06.964+0000 7f87c5cfc6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:51:07.202 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:06 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5[38505]: 2026-02-13T03:51:06.964+0000 7f87c5cfc6c0 -1 osd.5 72 *** Got signal Terminated *** 2026-02-13T03:51:07.202 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:06 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5[38505]: 2026-02-13T03:51:06.964+0000 7f87c5cfc6c0 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:51:07.797 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:07 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:07.302+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:07.842 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:07 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:07.474+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:07.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:07 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:07.583+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:08.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:07 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:07.841+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:08.297 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:08 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:08.255+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:08.298 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:08 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:08.040+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:08.701 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:08 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:08.430+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:08.701 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:08 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5[38505]: 2026-02-13T03:51:08.596+0000 7f87c23c16c0 -1 osd.5 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:43.250411+0000 front 2026-02-13T03:50:43.250438+0000 (oldest deadline 2026-02-13T03:51:08.550501+0000) 2026-02-13T03:51:08.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:08 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:08.618+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:09.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:08 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:08.878+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:09.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:09 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:09.260+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:09.548 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:09 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:09.050+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:09.877 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:09 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:09.478+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:09.877 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:09 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5[38505]: 2026-02-13T03:51:09.554+0000 7f87c23c16c0 -1 osd.5 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:43.250411+0000 front 2026-02-13T03:50:43.250438+0000 (oldest deadline 2026-02-13T03:51:08.550501+0000) 2026-02-13T03:51:09.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:09 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:09.602+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:10.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:09 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:09.874+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:10.297 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:10 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:10.043+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:10.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:10 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:10.259+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:10.907 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:10 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5[38505]: 2026-02-13T03:51:10.535+0000 7f87c23c16c0 -1 osd.5 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:43.250411+0000 front 2026-02-13T03:50:43.250438+0000 (oldest deadline 2026-02-13T03:51:08.550501+0000) 2026-02-13T03:51:10.907 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:10 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:10.471+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:10.907 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:10 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:10.471+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:10.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:10 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:10.560+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:10.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:10 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:10.560+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:11.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:10 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:10.906+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:11.297 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:11 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:11.039+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:11.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:11 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:11.248+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:11.473 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:10 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:10.972+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:11.887 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:11 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5[38505]: 2026-02-13T03:51:11.515+0000 7f87c23c16c0 -1 osd.5 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:43.250411+0000 front 2026-02-13T03:50:43.250438+0000 (oldest deadline 2026-02-13T03:51:08.550501+0000) 2026-02-13T03:51:11.888 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:11 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:11.471+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:11.888 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:11 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:11.471+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:11.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:11 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:11.525+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:11.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:11 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:11.525+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:12.189 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:11 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:11.886+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:12.189 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:12 trial177 podman[60256]: 2026-02-13 03:51:12.03429342 +0000 UTC m=+5.081635815 container died 864d24f47d392c289c734853ee2ae093a179116d209fd8c108286f989b0e2d67 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image) 2026-02-13T03:51:12.189 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:12 trial177 podman[60256]: 2026-02-13 03:51:12.043158743 +0000 UTC m=+5.090501148 container remove 864d24f47d392c289c734853ee2ae093a179116d209fd8c108286f989b0e2d67 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T03:51:12.190 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 13 03:51:12 trial177 bash[60256]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-5 2026-02-13T03:51:12.386 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.5.service' 2026-02-13T03:51:12.422 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:12.422 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-13T03:51:12.422 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-13T03:51:12.422 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.6 2026-02-13T03:51:12.445 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:12 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:12.052+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:12.445 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:12 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:12.262+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:12.473 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:12 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:12.000+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:12.797 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:12 trial070 systemd[1]: Stopping Ceph osd.6 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:12.797 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:12 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:12.525+0000 7f5713fd16c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:51:12.797 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:12 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:12.525+0000 7f5713fd16c0 -1 osd.6 72 *** Got signal Terminated *** 2026-02-13T03:51:12.798 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:12 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:12.525+0000 7f5713fd16c0 -1 osd.6 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:51:12.840 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:12 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:12.493+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:12.840 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:12 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:12.493+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:12.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:12 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:12.506+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:12.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:12 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:12.506+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:13.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:12 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:12.839+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:13.297 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:13 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:13.020+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:13.297 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:13 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:13.020+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:48.159442+0000 front 2026-02-13T03:50:48.159586+0000 (oldest deadline 2026-02-13T03:51:12.859431+0000) 2026-02-13T03:51:13.297 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:13 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:13.254+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:13.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:13 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:13.254+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:13.473 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:12 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:12.989+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:13.846 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:13 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:13.500+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:13.847 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:13 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:13.500+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:13.960 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:13 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:13.516+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:13.960 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:13 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:13.516+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:14.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:13 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:13.845+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:14.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:13 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:13.845+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:14.223 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:13 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:13.959+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:14.547 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:14 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:14.049+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:14.547 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:14 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:14.049+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:48.159442+0000 front 2026-02-13T03:50:48.159586+0000 (oldest deadline 2026-02-13T03:51:12.859431+0000) 2026-02-13T03:51:14.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:14 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:14.266+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:14.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:14 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:14.266+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:14.804 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:14 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:14.461+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:14.804 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:14 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:14.461+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:14.965 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:14 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:14.541+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:14.965 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:14 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:14.541+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:15.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:14 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:14.803+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:15.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:14 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:14.803+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:15.223 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:14 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:14.963+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:15.547 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:15 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:15.062+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:15.547 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:15 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:15.062+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:48.159442+0000 front 2026-02-13T03:50:48.159586+0000 (oldest deadline 2026-02-13T03:51:12.859431+0000) 2026-02-13T03:51:15.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:15 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:15.232+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:15.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:15 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:15.232+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:15.701 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:15 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:15.448+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:15.701 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:15 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:15.448+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:15.949 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:15 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:15.561+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:15.949 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:15 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:15.561+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:16.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:15 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:15.795+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:16.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:15 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:15.795+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:16.223 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:15 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:15.947+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:16.547 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:16 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:16.059+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:16.548 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:16 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:16.059+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:48.159442+0000 front 2026-02-13T03:50:48.159586+0000 (oldest deadline 2026-02-13T03:51:12.859431+0000) 2026-02-13T03:51:16.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:16 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:16.204+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:16.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:16 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:16.204+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:16.784 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:16 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:16.490+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:16.784 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:16 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:16.490+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:16.960 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:16 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:16.522+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:16.961 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:16 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:16.522+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:17.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:16 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:16.783+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:17.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:16 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:16.783+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:17.223 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:16 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:16.959+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:17.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:17 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:17.226+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:17.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:17 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:17.226+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:17.548 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:17.076+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.858671+0000 front 2026-02-13T03:50:41.858700+0000 (oldest deadline 2026-02-13T03:51:07.158767+0000) 2026-02-13T03:51:17.548 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:17.076+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:48.159442+0000 front 2026-02-13T03:50:48.159586+0000 (oldest deadline 2026-02-13T03:51:12.859431+0000) 2026-02-13T03:51:17.548 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6[49734]: 2026-02-13T03:51:17.076+0000 7f57106966c0 -1 osd.6 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:52.859760+0000 front 2026-02-13T03:50:52.859714+0000 (oldest deadline 2026-02-13T03:51:16.359718+0000) 2026-02-13T03:51:17.801 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:17 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:17.528+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:17.802 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:17 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:17.528+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:17.896 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 podman[81021]: 2026-02-13 03:51:17.594607727 +0000 UTC m=+5.081492510 container died a6884b56371ae98ebb04e24de6f9c340e814dc045ff00bf185a7944980ea310d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T03:51:17.897 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 podman[81021]: 2026-02-13 03:51:17.604185645 +0000 UTC m=+5.091070418 container remove a6884b56371ae98ebb04e24de6f9c340e814dc045ff00bf185a7944980ea310d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, ceph=True, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T03:51:17.897 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 bash[81021]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6 2026-02-13T03:51:17.897 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 podman[81153]: 2026-02-13 03:51:17.736324682 +0000 UTC m=+0.016955189 container create 2840f819a8f7bf98e55cbab4da30c29a9a6204bdc5f25423674ef7f2671fb97c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, ceph=True) 2026-02-13T03:51:17.897 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 podman[81153]: 2026-02-13 03:51:17.76845479 +0000 UTC m=+0.049085297 container init 2840f819a8f7bf98e55cbab4da30c29a9a6204bdc5f25423674ef7f2671fb97c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6-deactivate, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, name=rockylinux, ceph=True, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, OSD_FLAVOR=default, version=10, org.opencontainers.image.title=rockylinux) 2026-02-13T03:51:17.897 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 podman[81153]: 2026-02-13 03:51:17.771049337 +0000 UTC m=+0.051679834 container start 2840f819a8f7bf98e55cbab4da30c29a9a6204bdc5f25423674ef7f2671fb97c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6-deactivate, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, summary=Rocky Linux Base image) 2026-02-13T03:51:17.897 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 podman[81153]: 2026-02-13 03:51:17.771618785 +0000 UTC m=+0.052249293 container attach 2840f819a8f7bf98e55cbab4da30c29a9a6204bdc5f25423674ef7f2671fb97c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7) 2026-02-13T03:51:17.897 INFO:journalctl@ceph.osd.6.trial070.stdout:Feb 13 03:51:17 trial070 podman[81153]: 2026-02-13 03:51:17.72931909 +0000 UTC m=+0.009949597 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:51:17.925 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.6.service' 2026-02-13T03:51:17.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:17 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:17.512+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:17.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:17 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:17.512+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:18.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:18.002 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-13T03:51:18.002 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-13T03:51:18.002 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.7 2026-02-13T03:51:18.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:17 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:17.800+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:18.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:17 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:17.800+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:18.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:17 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:17.800+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:18.474 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:17 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:17.984+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:18.474 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:17 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:17.984+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:55.309022+0000 front 2026-02-13T03:50:55.309139+0000 (oldest deadline 2026-02-13T03:51:17.609045+0000) 2026-02-13T03:51:18.474 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:18 trial127 systemd[1]: Stopping Ceph osd.7 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:18.474 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:18 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:18.096+0000 7f6d4462c6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:51:18.474 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:18 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:18.096+0000 7f6d4462c6c0 -1 osd.7 72 *** Got signal Terminated *** 2026-02-13T03:51:18.474 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:18 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:18.096+0000 7f6d4462c6c0 -1 osd.7 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:51:18.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:18 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:18.214+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:18.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:18 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:18.214+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:18.948 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:18 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:18.557+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:18.948 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:18 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:18.557+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:18.948 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:18 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:18.557+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:18.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:18 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:18.759+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:18.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:18 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:18.759+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:18.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:18 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:18.759+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:18.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:18 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:18.554+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:18.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:18 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:18.554+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:18.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:18 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:18.554+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:19.223 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:18 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:18.946+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:19.224 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:18 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:18.946+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:55.309022+0000 front 2026-02-13T03:50:55.309139+0000 (oldest deadline 2026-02-13T03:51:17.609045+0000) 2026-02-13T03:51:19.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:19 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:19.235+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:19.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:19 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:19.235+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:19.852 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:19 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:19.746+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:19.852 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:19 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:19.746+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:19.853 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:19 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:19.746+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:19.853 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:19 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:19.570+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:19.853 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:19 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:19.570+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:19.853 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:19 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:19.570+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:19.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:19 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:19.533+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:19.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:19 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:19.533+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:19.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:19 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:19.533+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:20.473 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:19 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:19.993+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:20.474 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:19 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:19.993+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:55.309022+0000 front 2026-02-13T03:50:55.309139+0000 (oldest deadline 2026-02-13T03:51:17.609045+0000) 2026-02-13T03:51:20.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:20 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:20.197+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:20.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:20 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:20.197+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:20.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:20 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:20.197+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:20.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:20 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:20.712+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:20.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:20 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:20.712+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:20.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:20 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:20.712+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:20.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:20 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:20.616+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:20.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:20 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:20.616+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:20.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:20 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:20.616+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:20.959 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:20 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:20.527+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:20.960 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:20 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:20.527+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:20.960 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:20 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:20.527+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:21.223 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:20 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:20.958+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:21.224 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:20 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:20.958+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:55.309022+0000 front 2026-02-13T03:50:55.309139+0000 (oldest deadline 2026-02-13T03:51:17.609045+0000) 2026-02-13T03:51:21.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:21 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:21.157+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:21.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:21 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:21.157+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:21.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:21 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:21.157+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:21.947 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:21 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:21.576+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:21.948 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:21 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:21.576+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:21.948 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:21 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:21.576+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:21.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:21 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:21.749+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:21.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:21 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:21.749+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:21.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:21 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:21.749+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:21.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:21 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:21.610+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:21.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:21 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:21.610+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:21.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:21 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:21.610+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:22.223 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:21 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:21.946+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:22.224 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:21 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:21.946+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:55.309022+0000 front 2026-02-13T03:50:55.309139+0000 (oldest deadline 2026-02-13T03:51:17.609045+0000) 2026-02-13T03:51:22.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:22 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:22.196+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:22.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:22 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:22.196+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:22.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:22 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:22.196+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:22.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:22 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:22.562+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:22.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:22 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:22.562+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:22.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:22 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:22.562+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:22.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:22 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:22.761+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:22.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:22 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:22.761+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:22.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:22 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:22.761+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:22.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:22 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:22.585+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:22.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:22 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:22.585+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:22.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:22 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:22.585+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:23.303 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:22 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:22.976+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:45.408340+0000 front 2026-02-13T03:50:45.408355+0000 (oldest deadline 2026-02-13T03:51:10.708417+0000) 2026-02-13T03:51:23.303 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:22 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:22.976+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:55.309022+0000 front 2026-02-13T03:50:55.309139+0000 (oldest deadline 2026-02-13T03:51:17.609045+0000) 2026-02-13T03:51:23.303 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:22 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7[44047]: 2026-02-13T03:51:22.976+0000 7f6d3cce96c0 -1 osd.7 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:50:57.609263+0000 front 2026-02-13T03:50:57.609219+0000 (oldest deadline 2026-02-13T03:51:22.909294+0000) 2026-02-13T03:51:23.304 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:23 trial127 podman[58515]: 2026-02-13 03:51:23.166322559 +0000 UTC m=+5.082739128 container died 5c05656160023136377da65cb3ccb8098a75ddda54bce0b239e5040b91c4945d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10) 2026-02-13T03:51:23.304 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:23 trial127 podman[58515]: 2026-02-13 03:51:23.175220018 +0000 UTC m=+5.091636587 container remove 5c05656160023136377da65cb3ccb8098a75ddda54bce0b239e5040b91c4945d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, summary=Rocky Linux Base image, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:51:23.304 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:23 trial127 bash[58515]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7 2026-02-13T03:51:23.304 INFO:journalctl@ceph.osd.7.trial127.stdout:Feb 13 03:51:23 trial127 podman[58645]: 2026-02-13 03:51:23.30241468 +0000 UTC m=+0.016639629 container create 10db6546505d31546108d7274e89debeb324f986dec856d3b0a97d5732a65426 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, io.buildah.version=1.33.7) 2026-02-13T03:51:23.495 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.7.service' 2026-02-13T03:51:23.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:23.531 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-13T03:51:23.531 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-13T03:51:23.531 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.8 2026-02-13T03:51:23.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:23 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:23.153+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:23.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:23 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:23.153+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:23.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:23 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:23.153+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:23.577 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:23 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:23.575+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:23.577 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:23 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:23.575+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:23.577 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:23 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:23.575+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:23.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:23 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:23.569+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:23.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:23 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:23.569+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:23.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:23 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:23.569+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:23.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:23 trial177 systemd[1]: Stopping Ceph osd.8 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:23.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:23 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:23.630+0000 7f7af752b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:51:23.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:23 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:23.630+0000 7f7af752b6c0 -1 osd.8 72 *** Got signal Terminated *** 2026-02-13T03:51:23.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:23 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:23.630+0000 7f7af752b6c0 -1 osd.8 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:51:23.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:23 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:23.767+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:23.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:23 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:23.767+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:23.952 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:23 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:23.767+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:24.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:24 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:24.195+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:24.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:24 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:24.195+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:24.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:24 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:24.195+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:24.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:24 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:24.753+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:24.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:24 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:24.753+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:24.951 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:24 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:24.753+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:24.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:24 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:24.534+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:24.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:24 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:24.534+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:24.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:24 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:24.534+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:24.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:24 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:24.592+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:24.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:24 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:24.592+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:24.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:24 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:24.592+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:25.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:25 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:25.147+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:25.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:25 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:25.147+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:25.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:25 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:25.147+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:25.778 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:25 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:25.518+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:25.778 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:25 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:25.518+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:25.778 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:25 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:25.518+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:25.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:25 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:25.583+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:25.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:25 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:25.583+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:25.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:25 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:25.583+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:25.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:25 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:25.583+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:26.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:25 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:25.776+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:26.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:25 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:25.777+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:26.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:25 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:25.777+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:26.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:26 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:26.156+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:26.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:26 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:26.156+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:26.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:26 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:26.156+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:26.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:26 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:26.156+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.103189+0000 front 2026-02-13T03:51:00.103198+0000 (oldest deadline 2026-02-13T03:51:26.003292+0000) 2026-02-13T03:51:26.804 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:26 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:26.523+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:26.804 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:26 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:26.523+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:26.805 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:26 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:26.523+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:26.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:26 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:26.564+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:26.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:26 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:26.564+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:26.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:26 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:26.564+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:26.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:26 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:26.564+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:27.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:26 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:26.803+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:27.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:26 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:26.803+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:27.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:26 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:26.803+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:27.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:26 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:26.803+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.354930+0000 front 2026-02-13T03:51:00.355102+0000 (oldest deadline 2026-02-13T03:51:26.254935+0000) 2026-02-13T03:51:27.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:27 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:27.122+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:27.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:27 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:27.122+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:27.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:27 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:27.122+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:27.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:27 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:27.122+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.103189+0000 front 2026-02-13T03:51:00.103198+0000 (oldest deadline 2026-02-13T03:51:26.003292+0000) 2026-02-13T03:51:27.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:27 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:27.122+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:06.003703+0000 front 2026-02-13T03:51:06.003496+0000 (oldest deadline 2026-02-13T03:51:27.103573+0000) 2026-02-13T03:51:27.786 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:27 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:27.518+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:27.786 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:27 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:27.518+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:27.786 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:27 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:27.518+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:27.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:27 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:27.590+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:27.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:27 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:27.590+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:27.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:27 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:27.590+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:27.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:27 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:27.590+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:28.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:27 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:27.785+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:44.253042+0000 front 2026-02-13T03:50:44.253108+0000 (oldest deadline 2026-02-13T03:51:07.153069+0000) 2026-02-13T03:51:28.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:27 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:27.785+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.353861+0000 front 2026-02-13T03:50:49.353835+0000 (oldest deadline 2026-02-13T03:51:12.853937+0000) 2026-02-13T03:51:28.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:27 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:27.785+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.554322+0000 front 2026-02-13T03:50:54.554354+0000 (oldest deadline 2026-02-13T03:51:17.454527+0000) 2026-02-13T03:51:28.201 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:27 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8[44856]: 2026-02-13T03:51:27.785+0000 7f7aefbe86c0 -1 osd.8 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.354930+0000 front 2026-02-13T03:51:00.355102+0000 (oldest deadline 2026-02-13T03:51:26.254935+0000) 2026-02-13T03:51:28.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:28 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:28.088+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:28.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:28 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:28.088+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:28.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:28 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:28.088+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:28.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:28 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:28.088+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.103189+0000 front 2026-02-13T03:51:00.103198+0000 (oldest deadline 2026-02-13T03:51:26.003292+0000) 2026-02-13T03:51:28.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:28 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:28.088+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:06.003703+0000 front 2026-02-13T03:51:06.003496+0000 (oldest deadline 2026-02-13T03:51:27.103573+0000) 2026-02-13T03:51:28.828 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:28 trial177 podman[60524]: 2026-02-13 03:51:28.689229175 +0000 UTC m=+5.071992868 container died 0bc6ba84ebce0268a1b2cbb0b5e313b43ed25a50d77c8017d7435bf13be23ef9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.version=10, version=10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default) 2026-02-13T03:51:28.829 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:28 trial177 podman[60524]: 2026-02-13 03:51:28.698662375 +0000 UTC m=+5.081426068 container remove 0bc6ba84ebce0268a1b2cbb0b5e313b43ed25a50d77c8017d7435bf13be23ef9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8, ceph=True, version=10, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T03:51:28.829 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 13 03:51:28 trial177 bash[60524]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-8 2026-02-13T03:51:28.829 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:28 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:28.556+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:28.829 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:28 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:28.556+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:28.829 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:28 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:28.556+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:28.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:28 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:28.593+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:28.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:28 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:28.593+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:28.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:28 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:28.593+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:28.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:28 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:28.593+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:29.025 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.8.service' 2026-02-13T03:51:29.061 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:29.061 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-13T03:51:29.061 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-13T03:51:29.062 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.9 2026-02-13T03:51:29.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:29 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:29.061+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:29.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:29 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:29.061+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:29.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:29 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:29.061+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:29.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:29 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:29.061+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.103189+0000 front 2026-02-13T03:51:00.103198+0000 (oldest deadline 2026-02-13T03:51:26.003292+0000) 2026-02-13T03:51:29.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:29 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:29.061+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:06.003703+0000 front 2026-02-13T03:51:06.003496+0000 (oldest deadline 2026-02-13T03:51:27.103573+0000) 2026-02-13T03:51:29.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:29 trial070 systemd[1]: Stopping Ceph osd.9 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:29.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:29 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:29.158+0000 7f71792216c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:51:29.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:29 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:29.158+0000 7f71792216c0 -1 osd.9 72 *** Got signal Terminated *** 2026-02-13T03:51:29.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:29 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:29.158+0000 7f71792216c0 -1 osd.9 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:51:29.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:29 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:29.587+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:29.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:29 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:29.587+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:29.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:29 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:29.587+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:29.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:29 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:29.587+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:29.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:29 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:29.577+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:29.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:29 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:29.577+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:29.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:29 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:29.577+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:29.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:29 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:29.577+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:30.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:30 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:30.096+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:30.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:30 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:30.096+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:30.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:30 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:30.096+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:30.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:30 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:30.096+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.103189+0000 front 2026-02-13T03:51:00.103198+0000 (oldest deadline 2026-02-13T03:51:26.003292+0000) 2026-02-13T03:51:30.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:30 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:30.096+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:06.003703+0000 front 2026-02-13T03:51:06.003496+0000 (oldest deadline 2026-02-13T03:51:27.103573+0000) 2026-02-13T03:51:30.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:30 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:30.561+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:30.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:30 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:30.561+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:30.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:30 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:30.561+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:30.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:30 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:30.561+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:30.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:30 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:30.615+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:30.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:30 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:30.615+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:30.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:30 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:30.615+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:30.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:30 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:30.615+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:31.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:31 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:31.103+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:31.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:31 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:31.103+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:31.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:31 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:31.103+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:31.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:31 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:31.103+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.103189+0000 front 2026-02-13T03:51:00.103198+0000 (oldest deadline 2026-02-13T03:51:26.003292+0000) 2026-02-13T03:51:31.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:31 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:31.103+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:06.003703+0000 front 2026-02-13T03:51:06.003496+0000 (oldest deadline 2026-02-13T03:51:27.103573+0000) 2026-02-13T03:51:31.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:31 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:31.598+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:31.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:31 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:31.598+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:31.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:31 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:31.598+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:31.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:31 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:31.598+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:31.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:31 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:31.575+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:31.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:31 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:31.575+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:31.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:31 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:31.575+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:31.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:31 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:31.575+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:31.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:31 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:31.575+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:05.329998+0000 front 2026-02-13T03:51:05.330020+0000 (oldest deadline 2026-02-13T03:51:31.230075+0000) 2026-02-13T03:51:32.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:32 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:32.077+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:32.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:32 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:32.077+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:32.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:32 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:32.077+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:32.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:32 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:32.077+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.103189+0000 front 2026-02-13T03:51:00.103198+0000 (oldest deadline 2026-02-13T03:51:26.003292+0000) 2026-02-13T03:51:32.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:32 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:32.077+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:06.003703+0000 front 2026-02-13T03:51:06.003496+0000 (oldest deadline 2026-02-13T03:51:27.103573+0000) 2026-02-13T03:51:32.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:32.631+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:32.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:32.631+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:32.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:32.631+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:32.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:32 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:32.631+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:32.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:32 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:32.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:32.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:32 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:32.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:32.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:32 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:32.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:32.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:32 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:32.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:32.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:32 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:32.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:05.329998+0000 front 2026-02-13T03:51:05.330020+0000 (oldest deadline 2026-02-13T03:51:31.230075+0000) 2026-02-13T03:51:33.547 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:33 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:33.050+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:33.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:33 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:33.050+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:33.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:33 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:33.050+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:33.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:33 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:33.050+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.103189+0000 front 2026-02-13T03:51:00.103198+0000 (oldest deadline 2026-02-13T03:51:26.003292+0000) 2026-02-13T03:51:33.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:33 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:33.050+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:06.003703+0000 front 2026-02-13T03:51:06.003496+0000 (oldest deadline 2026-02-13T03:51:27.103573+0000) 2026-02-13T03:51:33.548 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:33 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:33.050+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:10.004003+0000 front 2026-02-13T03:51:10.003939+0000 (oldest deadline 2026-02-13T03:51:32.904039+0000) 2026-02-13T03:51:33.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:33.596+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:33.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:33.596+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:33.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:33.596+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:33.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:33 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:33.596+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:33.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:33.640+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:33.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:33.640+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:33.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:33.640+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:33.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:33.640+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:33.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:33 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:33.640+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:05.329998+0000 front 2026-02-13T03:51:05.330020+0000 (oldest deadline 2026-02-13T03:51:31.230075+0000) 2026-02-13T03:51:34.297 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:34 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:34.024+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.801540+0000 front 2026-02-13T03:50:39.801553+0000 (oldest deadline 2026-02-13T03:51:04.501678+0000) 2026-02-13T03:51:34.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:34 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:34.024+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.002647+0000 front 2026-02-13T03:50:49.002624+0000 (oldest deadline 2026-02-13T03:51:12.502665+0000) 2026-02-13T03:51:34.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:34 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:34.024+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.203024+0000 front 2026-02-13T03:50:54.203081+0000 (oldest deadline 2026-02-13T03:51:20.103062+0000) 2026-02-13T03:51:34.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:34 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:34.024+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.103189+0000 front 2026-02-13T03:51:00.103198+0000 (oldest deadline 2026-02-13T03:51:26.003292+0000) 2026-02-13T03:51:34.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:34 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:34.024+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:06.003703+0000 front 2026-02-13T03:51:06.003496+0000 (oldest deadline 2026-02-13T03:51:27.103573+0000) 2026-02-13T03:51:34.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:34 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9[56065]: 2026-02-13T03:51:34.024+0000 7f71718de6c0 -1 osd.9 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:10.004003+0000 front 2026-02-13T03:51:10.003939+0000 (oldest deadline 2026-02-13T03:51:32.904039+0000) 2026-02-13T03:51:34.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:34 trial070 podman[81290]: 2026-02-13 03:51:34.217796925 +0000 UTC m=+5.072485997 container died 8f97b4c9059ea645c78a9dc567d6ad71e883340b6e4b4c4d06c19d1d3cc9aa5c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T03:51:34.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:34 trial070 podman[81290]: 2026-02-13 03:51:34.227409345 +0000 UTC m=+5.082098407 container remove 8f97b4c9059ea645c78a9dc567d6ad71e883340b6e4b4c4d06c19d1d3cc9aa5c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, version=10) 2026-02-13T03:51:34.298 INFO:journalctl@ceph.osd.9.trial070.stdout:Feb 13 03:51:34 trial070 bash[81290]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-9 2026-02-13T03:51:34.542 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.9.service' 2026-02-13T03:51:34.579 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:34.579 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-13T03:51:34.579 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-13T03:51:34.579 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.10 2026-02-13T03:51:34.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:34 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:34.636+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:34.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:34 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:34.636+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:34.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:34 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:34.636+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:34.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:34 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:34.636+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:34.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:34 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:34.636+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:34.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:34 trial127 systemd[1]: Stopping Ceph osd.10 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:34.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:34.643+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:34.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:34.643+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:34.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:34.643+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:34.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:34.643+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:34.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:34.643+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:05.329998+0000 front 2026-02-13T03:51:05.330020+0000 (oldest deadline 2026-02-13T03:51:31.230075+0000) 2026-02-13T03:51:34.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:34.680+0000 7ffa062346c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:51:34.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:34.680+0000 7ffa062346c0 -1 osd.10 72 *** Got signal Terminated *** 2026-02-13T03:51:34.975 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:34 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:34.680+0000 7ffa062346c0 -1 osd.10 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:51:35.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:35 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:35.600+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:35.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:35 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:35.600+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:35.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:35 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:35.600+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:35.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:35 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:35.600+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:35.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:35 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:35.600+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:35.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:35 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:35.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:35.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:35 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:35.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:35.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:35 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:35.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:35.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:35 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:35.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:35.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:35 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:35.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:05.329998+0000 front 2026-02-13T03:51:05.330020+0000 (oldest deadline 2026-02-13T03:51:31.230075+0000) 2026-02-13T03:51:35.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:35 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:35.616+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:11.230298+0000 front 2026-02-13T03:51:11.230378+0000 (oldest deadline 2026-02-13T03:51:35.330289+0000) 2026-02-13T03:51:36.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:36 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:36.551+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:36.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:36 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:36.551+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:36.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:36 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:36.551+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:36.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:36 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:36.551+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:36.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:36 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:36.551+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:36.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:36 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:36.571+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:36.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:36 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:36.571+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:36.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:36 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:36.571+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:36.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:36 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:36.571+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:36.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:36 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:36.571+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:05.329998+0000 front 2026-02-13T03:51:05.330020+0000 (oldest deadline 2026-02-13T03:51:31.230075+0000) 2026-02-13T03:51:36.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:36 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:36.571+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:11.230298+0000 front 2026-02-13T03:51:11.230378+0000 (oldest deadline 2026-02-13T03:51:35.330289+0000) 2026-02-13T03:51:37.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:37 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:37.576+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:37.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:37 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:37.576+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:37.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:37 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:37.576+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:37.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:37 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:37.576+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:37.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:37 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:37.576+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:37.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:37 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:37.541+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:37.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:37 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:37.541+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:37.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:37 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:37.541+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:37.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:37 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:37.541+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:37.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:37 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:37.541+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:05.329998+0000 front 2026-02-13T03:51:05.330020+0000 (oldest deadline 2026-02-13T03:51:31.230075+0000) 2026-02-13T03:51:37.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:37 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:37.541+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:11.230298+0000 front 2026-02-13T03:51:11.230378+0000 (oldest deadline 2026-02-13T03:51:35.330289+0000) 2026-02-13T03:51:38.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:38 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:38.567+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:38.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:38 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:38.567+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:38.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:38 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:38.567+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:38.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:38 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:38.567+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:38.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:38 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:38.567+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:38.973 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:38 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:38.553+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:38.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:38 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:38.553+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:38.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:38 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:38.553+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:38.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:38 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:38.553+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:38.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:38 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:38.553+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:05.329998+0000 front 2026-02-13T03:51:05.330020+0000 (oldest deadline 2026-02-13T03:51:31.230075+0000) 2026-02-13T03:51:38.974 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:38 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:38.553+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:11.230298+0000 front 2026-02-13T03:51:11.230378+0000 (oldest deadline 2026-02-13T03:51:35.330289+0000) 2026-02-13T03:51:39.873 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:39.576+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:39.227958+0000 front 2026-02-13T03:50:39.228018+0000 (oldest deadline 2026-02-13T03:51:04.527893+0000) 2026-02-13T03:51:39.874 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:39.576+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:49.128580+0000 front 2026-02-13T03:50:49.128594+0000 (oldest deadline 2026-02-13T03:51:10.228680+0000) 2026-02-13T03:51:39.874 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:39.576+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:53.729195+0000 front 2026-02-13T03:50:53.729113+0000 (oldest deadline 2026-02-13T03:51:17.829213+0000) 2026-02-13T03:51:39.874 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:39.576+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.70:6814 osd.3 since back 2026-02-13T03:51:00.629915+0000 front 2026-02-13T03:51:00.630010+0000 (oldest deadline 2026-02-13T03:51:25.329867+0000) 2026-02-13T03:51:39.874 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:39.576+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:05.329998+0000 front 2026-02-13T03:51:05.330020+0000 (oldest deadline 2026-02-13T03:51:31.230075+0000) 2026-02-13T03:51:39.874 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10[50479]: 2026-02-13T03:51:39.576+0000 7ffa028f96c0 -1 osd.10 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:11.230298+0000 front 2026-02-13T03:51:11.230378+0000 (oldest deadline 2026-02-13T03:51:35.330289+0000) 2026-02-13T03:51:39.874 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 podman[58785]: 2026-02-13 03:51:39.739319009 +0000 UTC m=+5.071933619 container died 4760b3625b0aab8c99a7c8936ec76942cf78258cce8bee1c6cc4efffd8e97f15 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, version=10) 2026-02-13T03:51:39.874 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 podman[58785]: 2026-02-13 03:51:39.747780256 +0000 UTC m=+5.080394856 container remove 4760b3625b0aab8c99a7c8936ec76942cf78258cce8bee1c6cc4efffd8e97f15 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10) 2026-02-13T03:51:39.874 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 bash[58785]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10 2026-02-13T03:51:39.874 INFO:journalctl@ceph.osd.10.trial127.stdout:Feb 13 03:51:39 trial127 podman[58913]: 2026-02-13 03:51:39.87213858 +0000 UTC m=+0.016047407 container create 5ef3e62b00902e381197ad3776b4755efa6e4ac88ae61670ae255c4ed36e223f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:51:39.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:39 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:39.564+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:39.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:39 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:39.564+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:39.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:39 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:39.564+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:39.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:39 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:39.564+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:39.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:39 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:39.564+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:40.053 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.10.service' 2026-02-13T03:51:40.091 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:40.092 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-13T03:51:40.092 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-13T03:51:40.092 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.11 2026-02-13T03:51:40.451 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:40 trial177 systemd[1]: Stopping Ceph osd.11 for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:40.451 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:40 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:40.187+0000 7f37df58a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T03:51:40.451 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:40 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:40.187+0000 7f37df58a6c0 -1 osd.11 72 *** Got signal Terminated *** 2026-02-13T03:51:40.451 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:40 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:40.187+0000 7f37df58a6c0 -1 osd.11 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T03:51:40.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:40 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:40.515+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:40.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:40 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:40.515+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:40.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:40 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:40.515+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:40.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:40 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:40.515+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:40.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:40 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:40.515+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:41.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:41 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:41.470+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:41.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:41 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:41.470+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:41.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:41 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:41.470+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:41.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:41 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:41.470+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:41.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:41 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:41.470+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:42.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:42 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:42.512+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:42.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:42 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:42.512+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:42.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:42 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:42.512+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:42.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:42 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:42.512+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:42.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:42 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:42.512+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:42.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:42 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:42.512+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6822 osd.6 since back 2026-02-13T03:51:17.203203+0000 front 2026-02-13T03:51:17.203168+0000 (oldest deadline 2026-02-13T03:51:42.503153+0000) 2026-02-13T03:51:43.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:43 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:43.547+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:43.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:43 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:43.547+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:43.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:43 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:43.547+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:43.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:43 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:43.547+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:43.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:43 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:43.547+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:43.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:43 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:43.547+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6822 osd.6 since back 2026-02-13T03:51:17.203203+0000 front 2026-02-13T03:51:17.203168+0000 (oldest deadline 2026-02-13T03:51:42.503153+0000) 2026-02-13T03:51:44.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:44 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:44.544+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6806 osd.0 since back 2026-02-13T03:50:41.200661+0000 front 2026-02-13T03:50:41.200506+0000 (oldest deadline 2026-02-13T03:51:04.700531+0000) 2026-02-13T03:51:44.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:44 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:44.544+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6804 osd.1 since back 2026-02-13T03:50:44.700818+0000 front 2026-02-13T03:50:44.700708+0000 (oldest deadline 2026-02-13T03:51:10.000736+0000) 2026-02-13T03:51:44.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:44 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:44.544+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-13T03:50:54.701112+0000 front 2026-02-13T03:50:54.701121+0000 (oldest deadline 2026-02-13T03:51:18.201212+0000) 2026-02-13T03:51:44.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:44 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:44.544+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.127:6812 osd.4 since back 2026-02-13T03:51:03.902130+0000 front 2026-02-13T03:51:03.902102+0000 (oldest deadline 2026-02-13T03:51:29.202161+0000) 2026-02-13T03:51:44.951 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:44 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:44.544+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-13T03:51:09.702577+0000 front 2026-02-13T03:51:09.702515+0000 (oldest deadline 2026-02-13T03:51:34.402556+0000) 2026-02-13T03:51:44.952 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:44 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11[51097]: 2026-02-13T03:51:44.544+0000 7f37dbc4f6c0 -1 osd.11 72 heartbeat_check: no reply from 10.20.193.70:6822 osd.6 since back 2026-02-13T03:51:17.203203+0000 front 2026-02-13T03:51:17.203168+0000 (oldest deadline 2026-02-13T03:51:42.503153+0000) 2026-02-13T03:51:45.530 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:45 trial177 podman[60784]: 2026-02-13 03:51:45.246126069 +0000 UTC m=+5.071762503 container died 3595647a47fc441a6ede1376af65d51587fdb6cb93a7c97c49d056d9f3b23b34 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , version=10, io.buildah.version=1.33.7) 2026-02-13T03:51:45.530 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:45 trial177 podman[60784]: 2026-02-13 03:51:45.254655319 +0000 UTC m=+5.080291753 container remove 3595647a47fc441a6ede1376af65d51587fdb6cb93a7c97c49d056d9f3b23b34 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True) 2026-02-13T03:51:45.531 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:45 trial177 bash[60784]: ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11 2026-02-13T03:51:45.531 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:45 trial177 podman[60914]: 2026-02-13 03:51:45.376331899 +0000 UTC m=+0.016473303 container create af6bcba66e1182f9afa8afcfcf172fe20852836c4ca2b7bfe5660ebde258a4f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.version=10, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T03:51:45.531 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:45 trial177 podman[60914]: 2026-02-13 03:51:45.406704871 +0000 UTC m=+0.046846205 container init af6bcba66e1182f9afa8afcfcf172fe20852836c4ca2b7bfe5660ebde258a4f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T03:51:45.531 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:45 trial177 podman[60914]: 2026-02-13 03:51:45.409017899 +0000 UTC m=+0.049159233 container start af6bcba66e1182f9afa8afcfcf172fe20852836c4ca2b7bfe5660ebde258a4f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, ceph=True) 2026-02-13T03:51:45.531 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:45 trial177 podman[60914]: 2026-02-13 03:51:45.409638162 +0000 UTC m=+0.049779496 container attach af6bcba66e1182f9afa8afcfcf172fe20852836c4ca2b7bfe5660ebde258a4f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:51:45.531 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:45 trial177 podman[60914]: 2026-02-13 03:51:45.369859602 +0000 UTC m=+0.010000946 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:51:45.531 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 13 03:51:45 trial177 podman[60914]: 2026-02-13 03:51:45.529580219 +0000 UTC m=+0.169721563 container died af6bcba66e1182f9afa8afcfcf172fe20852836c4ca2b7bfe5660ebde258a4f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, name=rockylinux, license=BSD-3-Clause, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, version=10, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T03:51:45.559 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@osd.11.service' 2026-02-13T03:51:45.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:45.596 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-13T03:51:45.596 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-13T03:51:45.596 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.a 2026-02-13T03:51:46.047 INFO:journalctl@ceph.mds.a.trial070.stdout:Feb 13 03:51:45 trial070 systemd[1]: Stopping Ceph mds.a for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:46.048 INFO:journalctl@ceph.mds.a.trial070.stdout:Feb 13 03:51:45 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-a[61791]: 2026-02-13T03:51:45.692+0000 7f74272506c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:51:46.048 INFO:journalctl@ceph.mds.a.trial070.stdout:Feb 13 03:51:45 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-a[61791]: 2026-02-13T03:51:45.692+0000 7f74272506c0 -1 mds.a *** got signal Terminated *** 2026-02-13T03:51:46.744 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.a.service' 2026-02-13T03:51:46.778 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:46.778 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-13T03:51:46.778 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-13T03:51:46.779 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.d 2026-02-13T03:51:46.912 INFO:journalctl@ceph.mds.d.trial070.stdout:Feb 13 03:51:46 trial070 systemd[1]: Stopping Ceph mds.d for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:47.297 INFO:journalctl@ceph.mds.d.trial070.stdout:Feb 13 03:51:46 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-d[60940]: 2026-02-13T03:51:46.911+0000 7f8c0fe236c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:51:47.297 INFO:journalctl@ceph.mds.d.trial070.stdout:Feb 13 03:51:46 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-d[60940]: 2026-02-13T03:51:46.911+0000 7f8c0fe236c0 -1 mds.d *** got signal Terminated *** 2026-02-13T03:51:47.954 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.d.service' 2026-02-13T03:51:47.988 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:47.988 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-13T03:51:47.988 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-13T03:51:47.988 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.g 2026-02-13T03:51:48.127 INFO:journalctl@ceph.mds.g.trial070.stdout:Feb 13 03:51:48 trial070 systemd[1]: Stopping Ceph mds.g for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:48.547 INFO:journalctl@ceph.mds.g.trial070.stdout:Feb 13 03:51:48 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-g[61469]: 2026-02-13T03:51:48.126+0000 7f0c1a7556c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:51:48.547 INFO:journalctl@ceph.mds.g.trial070.stdout:Feb 13 03:51:48 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-g[61469]: 2026-02-13T03:51:48.126+0000 7f0c1a7556c0 -1 mds.g *** got signal Terminated *** 2026-02-13T03:51:49.158 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.g.service' 2026-02-13T03:51:49.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:49.191 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-13T03:51:49.192 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-13T03:51:49.192 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.j 2026-02-13T03:51:49.547 INFO:journalctl@ceph.mds.j.trial070.stdout:Feb 13 03:51:49 trial070 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-j[60576]: 2026-02-13T03:51:49.320+0000 7fe8984016c0 -1 mds.j *** got signal Terminated *** 2026-02-13T03:51:50.354 DEBUG:teuthology.orchestra.run.trial070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.j.service' 2026-02-13T03:51:50.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:50.388 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-13T03:51:50.388 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-13T03:51:50.388 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.b 2026-02-13T03:51:50.724 INFO:journalctl@ceph.mds.b.trial127.stdout:Feb 13 03:51:50 trial127 systemd[1]: Stopping Ceph mds.b for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:50.724 INFO:journalctl@ceph.mds.b.trial127.stdout:Feb 13 03:51:50 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-b[55247]: 2026-02-13T03:51:50.480+0000 7f0c9fd086c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:51:50.724 INFO:journalctl@ceph.mds.b.trial127.stdout:Feb 13 03:51:50 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-b[55247]: 2026-02-13T03:51:50.480+0000 7f0c9fd086c0 -1 mds.b *** got signal Terminated *** 2026-02-13T03:51:55.512 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.b.service' 2026-02-13T03:51:55.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:55.548 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-13T03:51:55.549 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-13T03:51:55.549 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.e 2026-02-13T03:51:55.683 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:51:55 trial127 systemd[1]: Stopping Ceph mds.e for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:55.973 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:51:55 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-e[54607]: 2026-02-13T03:51:55.680+0000 7ff4083d96c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:51:55.974 INFO:journalctl@ceph.mds.e.trial127.stdout:Feb 13 03:51:55 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-e[54607]: 2026-02-13T03:51:55.680+0000 7ff4083d96c0 -1 mds.e *** got signal Terminated *** 2026-02-13T03:51:56.718 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.e.service' 2026-02-13T03:51:56.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:56.752 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-13T03:51:56.752 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-13T03:51:56.753 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.h 2026-02-13T03:51:56.974 INFO:journalctl@ceph.mds.h.trial127.stdout:Feb 13 03:51:56 trial127 systemd[1]: Stopping Ceph mds.h for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:56.974 INFO:journalctl@ceph.mds.h.trial127.stdout:Feb 13 03:51:56 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-h[54930]: 2026-02-13T03:51:56.886+0000 7ff84e6be6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:51:56.974 INFO:journalctl@ceph.mds.h.trial127.stdout:Feb 13 03:51:56 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-h[54930]: 2026-02-13T03:51:56.886+0000 7ff84e6be6c0 -1 mds.h *** got signal Terminated *** 2026-02-13T03:51:57.928 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.h.service' 2026-02-13T03:51:57.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:57.962 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-13T03:51:57.962 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-13T03:51:57.962 DEBUG:teuthology.orchestra.run.trial127:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.k 2026-02-13T03:51:58.224 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:51:58 trial127 systemd[1]: Stopping Ceph mds.k for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:58.224 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:51:58 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-k[54293]: 2026-02-13T03:51:58.094+0000 7f7bb99bf6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:51:58.224 INFO:journalctl@ceph.mds.k.trial127.stdout:Feb 13 03:51:58 trial127 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-k[54293]: 2026-02-13T03:51:58.094+0000 7f7bb99bf6c0 -1 mds.k *** got signal Terminated *** 2026-02-13T03:51:59.127 DEBUG:teuthology.orchestra.run.trial127:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.k.service' 2026-02-13T03:51:59.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:51:59.160 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-13T03:51:59.160 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-13T03:51:59.160 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.c 2026-02-13T03:51:59.451 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 13 03:51:59 trial177 systemd[1]: Stopping Ceph mds.c for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:51:59.451 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 13 03:51:59 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-c[55779]: 2026-02-13T03:51:59.255+0000 7f95ca9616c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:51:59.451 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 13 03:51:59 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-c[55779]: 2026-02-13T03:51:59.255+0000 7f95ca9616c0 -1 mds.c *** got signal Terminated *** 2026-02-13T03:52:00.303 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.c.service' 2026-02-13T03:52:00.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:52:00.338 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-13T03:52:00.338 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-13T03:52:00.338 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.f 2026-02-13T03:52:00.476 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 13 03:52:00 trial177 systemd[1]: Stopping Ceph mds.f for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:52:00.951 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 13 03:52:00 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-f[55450]: 2026-02-13T03:52:00.474+0000 7fed404516c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:52:00.951 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 13 03:52:00 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-f[55450]: 2026-02-13T03:52:00.474+0000 7fed404516c0 -1 mds.f *** got signal Terminated *** 2026-02-13T03:52:01.519 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.f.service' 2026-02-13T03:52:01.552 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:52:01.553 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-13T03:52:01.553 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-13T03:52:01.553 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.i 2026-02-13T03:52:01.701 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 13 03:52:01 trial177 systemd[1]: Stopping Ceph mds.i for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:52:01.701 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 13 03:52:01 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-i[56101]: 2026-02-13T03:52:01.683+0000 7f3390d6e6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:52:01.701 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 13 03:52:01 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-i[56101]: 2026-02-13T03:52:01.683+0000 7f3390d6e6c0 -1 mds.i *** got signal Terminated *** 2026-02-13T03:52:02.929 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.i.service' 2026-02-13T03:52:02.962 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:52:02.963 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-13T03:52:02.963 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-13T03:52:02.963 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.l 2026-02-13T03:52:03.107 INFO:journalctl@ceph.mds.l.trial177.stdout:Feb 13 03:52:03 trial177 systemd[1]: Stopping Ceph mds.l for 0c5cf8b4-088e-11f1-b830-d404e6e7d460... 2026-02-13T03:52:03.451 INFO:journalctl@ceph.mds.l.trial177.stdout:Feb 13 03:52:03 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-l[55126]: 2026-02-13T03:52:03.105+0000 7f839d1206c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:52:03.451 INFO:journalctl@ceph.mds.l.trial177.stdout:Feb 13 03:52:03 trial177 ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460-mds-l[55126]: 2026-02-13T03:52:03.105+0000 7f839d1206c0 -1 mds.l *** got signal Terminated *** 2026-02-13T03:52:04.141 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0c5cf8b4-088e-11f1-b830-d404e6e7d460@mds.l.service' 2026-02-13T03:52:04.173 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T03:52:04.174 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-13T03:52:04.174 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 --force --keep-logs 2026-02-13T03:52:04.295 INFO:teuthology.orchestra.run.trial070.stdout:Deleting cluster with fsid: 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:52:06.084 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 --force --keep-logs 2026-02-13T03:52:06.203 INFO:teuthology.orchestra.run.trial127.stdout:Deleting cluster with fsid: 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:52:07.952 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 --force --keep-logs 2026-02-13T03:52:08.073 INFO:teuthology.orchestra.run.trial177.stdout:Deleting cluster with fsid: 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:52:09.887 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:52:09.916 DEBUG:teuthology.orchestra.run.trial127:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:52:09.945 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:52:09.974 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-13T03:52:09.977 DEBUG:teuthology.misc:Transferring archived files from trial070:/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108/remote/trial070/crash 2026-02-13T03:52:09.978 DEBUG:teuthology.orchestra.run.trial070:> sudo tar c -f - -C /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash -- . 2026-02-13T03:52:10.003 INFO:teuthology.orchestra.run.trial070.stderr:tar: /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T03:52:10.003 INFO:teuthology.orchestra.run.trial070.stderr:tar: Error is not recoverable: exiting now 2026-02-13T03:52:10.005 DEBUG:teuthology.misc:Transferring archived files from trial127:/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108/remote/trial127/crash 2026-02-13T03:52:10.006 DEBUG:teuthology.orchestra.run.trial127:> sudo tar c -f - -C /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash -- . 2026-02-13T03:52:10.033 INFO:teuthology.orchestra.run.trial127.stderr:tar: /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T03:52:10.033 INFO:teuthology.orchestra.run.trial127.stderr:tar: Error is not recoverable: exiting now 2026-02-13T03:52:10.035 DEBUG:teuthology.misc:Transferring archived files from trial177:/var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108/remote/trial177/crash 2026-02-13T03:52:10.036 DEBUG:teuthology.orchestra.run.trial177:> sudo tar c -f - -C /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash -- . 2026-02-13T03:52:10.061 INFO:teuthology.orchestra.run.trial177.stderr:tar: /var/lib/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T03:52:10.061 INFO:teuthology.orchestra.run.trial177.stderr:tar: Error is not recoverable: exiting now 2026-02-13T03:52:10.062 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-13T03:52:10.063 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T03:52:10.091 INFO:teuthology.orchestra.run.trial070.stdout:2026-02-13T03:43:39.022574+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:52:10.092 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-13T03:52:10.092 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -E '\[SEC\]' /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T03:52:10.157 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -E '\[ERR\]' /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T03:52:10.222 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -E '\[WRN\]' /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T03:52:10.288 INFO:teuthology.orchestra.run.trial070.stdout:2026-02-13T03:43:39.022574+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:52:10.288 INFO:tasks.cephadm:Compressing logs... 2026-02-13T03:52:10.289 DEBUG:teuthology.orchestra.run.trial070:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:52:10.330 DEBUG:teuthology.orchestra.run.trial127:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:52:10.333 DEBUG:teuthology.orchestra.run.trial177:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:52:10.352 INFO:teuthology.orchestra.run.trial070.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T03:52:10.352 INFO:teuthology.orchestra.run.trial070.stderr:: No such file or directory 2026-02-13T03:52:10.352 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mon.a.log 2026-02-13T03:52:10.352 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.d.log 2026-02-13T03:52:10.352 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.j.log 2026-02-13T03:52:10.353 INFO:teuthology.orchestra.run.trial070.stderr:gzip/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.d.log: -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.0.log 2026-02-13T03:52:10.353 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.3.log 2026-02-13T03:52:10.353 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.cephadm.log/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.0.log: 2026-02-13T03:52:10.356 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.a.log 2026-02-13T03:52:10.356 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.g.log 2026-02-13T03:52:10.356 INFO:teuthology.orchestra.run.trial070.stderr: 43.6% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T03:52:10.356 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.audit.log 2026-02-13T03:52:10.356 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-volume.log 2026-02-13T03:52:10.356 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.audit.log: 95.0% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.d.log.gz 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr: 94.9% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.j.log.gz 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.6.log 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr: 94.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mgr.x.log 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mgr.x.log: -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.9.log 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log: 94.9% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.a.log.gz 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.9.log: 90.9% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.audit.log.gz 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr: 86.8% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log.gz 2026-02-13T03:52:10.357 INFO:teuthology.orchestra.run.trial070.stderr: 94.9% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.g.log.gz 2026-02-13T03:52:10.362 INFO:teuthology.orchestra.run.trial127.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T03:52:10.362 INFO:teuthology.orchestra.run.trial127.stderr:: No such file or directory 2026-02-13T03:52:10.362 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mgr.y.log 2026-02-13T03:52:10.362 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.b.log 2026-02-13T03:52:10.362 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.h.log 2026-02-13T03:52:10.362 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.7.log 2026-02-13T03:52:10.362 INFO:teuthology.orchestra.run.trial127.stderr: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T03:52:10.362 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.10.log 2026-02-13T03:52:10.362 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.4.log 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.audit.log 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.10.log: /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mon.b.log 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-volume.log 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.1.log 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr: 92.3% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.1.log: 94.9% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.h.log.gz 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.k.log 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.e.log 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.k.log: 91.0% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.audit.log.gz 2026-02-13T03:52:10.363 INFO:teuthology.orchestra.run.trial127.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.e.log: 86.8% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log.gz 2026-02-13T03:52:10.364 INFO:teuthology.orchestra.run.trial127.stderr: 94.8% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.k.log.gz 2026-02-13T03:52:10.364 INFO:teuthology.orchestra.run.trial127.stderr: 94.8% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.e.log.gz 2026-02-13T03:52:10.364 INFO:teuthology.orchestra.run.trial070.stderr: 93.4% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-volume.log.gz 2026-02-13T03:52:10.365 INFO:teuthology.orchestra.run.trial127.stderr: 93.4% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-volume.log.gz 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr:: No such file or directory 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.2.log 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.i.log 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mon.c.log 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.f.log 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.5.log 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.11.log 2026-02-13T03:52:10.369 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.audit.log 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-volume.log 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mgr.z.log 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.l.log 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.c.log 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr: 94.8% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.f.log.gz 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.8.log 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log: 91.0% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.audit.log.gz 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.8.log: 86.8% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph.log.gz 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr: 92.2% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr: 94.9% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.l.log.gz 2026-02-13T03:52:10.370 INFO:teuthology.orchestra.run.trial177.stderr: 94.8% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.c.log.gz 2026-02-13T03:52:10.371 INFO:teuthology.orchestra.run.trial177.stderr: 93.9% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-volume.log.gz 2026-02-13T03:52:10.373 INFO:teuthology.orchestra.run.trial177.stderr: 94.6% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.i.log.gz 2026-02-13T03:52:10.384 INFO:teuthology.orchestra.run.trial127.stderr: 93.5% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mds.b.log.gz 2026-02-13T03:52:10.442 INFO:teuthology.orchestra.run.trial127.stderr: 92.2% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mon.b.log.gz 2026-02-13T03:52:10.445 INFO:teuthology.orchestra.run.trial177.stderr: 92.2% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mon.c.log.gz 2026-02-13T03:52:10.446 INFO:teuthology.orchestra.run.trial070.stderr: 90.1% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-13T03:52:10.486 INFO:teuthology.orchestra.run.trial177.stderr: 92.9% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.11.log.gz 2026-02-13T03:52:10.488 INFO:teuthology.orchestra.run.trial070.stderr: 92.4% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.9.log.gz 2026-02-13T03:52:10.493 INFO:teuthology.orchestra.run.trial070.stderr: 92.5% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.6.log.gz 2026-02-13T03:52:10.495 INFO:teuthology.orchestra.run.trial127.stderr: 92.4% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.4.log.gz 2026-02-13T03:52:10.510 INFO:teuthology.orchestra.run.trial070.stderr: 92.4% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.3.log.gz 2026-02-13T03:52:10.510 INFO:teuthology.orchestra.run.trial177.stderr: 92.6% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.8.log.gz 2026-02-13T03:52:10.514 INFO:teuthology.orchestra.run.trial127.stderr: 92.6% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.7.log.gz 2026-02-13T03:52:10.514 INFO:teuthology.orchestra.run.trial070.stderr: 92.4% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.0.log.gz 2026-02-13T03:52:10.533 INFO:teuthology.orchestra.run.trial177.stderr: 92.3% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.5.log.gz 2026-02-13T03:52:10.536 INFO:teuthology.orchestra.run.trial177.stderr: 92.3% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.2.log.gz 2026-02-13T03:52:10.537 INFO:teuthology.orchestra.run.trial177.stderr: 2026-02-13T03:52:10.537 INFO:teuthology.orchestra.run.trial177.stderr:real 0m0.187s 2026-02-13T03:52:10.537 INFO:teuthology.orchestra.run.trial177.stderr:user 0m0.698s 2026-02-13T03:52:10.537 INFO:teuthology.orchestra.run.trial177.stderr:sys 0m0.064s 2026-02-13T03:52:10.551 INFO:teuthology.orchestra.run.trial127.stderr: 92.2% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.10.log.gz 2026-02-13T03:52:10.558 INFO:teuthology.orchestra.run.trial127.stderr: 92.2% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-osd.1.log.gz 2026-02-13T03:52:10.559 INFO:teuthology.orchestra.run.trial127.stderr: 2026-02-13T03:52:10.559 INFO:teuthology.orchestra.run.trial127.stderr:real 0m0.212s 2026-02-13T03:52:10.559 INFO:teuthology.orchestra.run.trial127.stderr:user 0m0.783s 2026-02-13T03:52:10.559 INFO:teuthology.orchestra.run.trial127.stderr:sys 0m0.055s 2026-02-13T03:52:10.643 INFO:teuthology.orchestra.run.trial070.stderr: 90.2% -- replaced with /var/log/ceph/0c5cf8b4-088e-11f1-b830-d404e6e7d460/ceph-mon.a.log.gz 2026-02-13T03:52:10.645 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-13T03:52:10.645 INFO:teuthology.orchestra.run.trial070.stderr:real 0m0.302s 2026-02-13T03:52:10.646 INFO:teuthology.orchestra.run.trial070.stderr:user 0m0.943s 2026-02-13T03:52:10.646 INFO:teuthology.orchestra.run.trial070.stderr:sys 0m0.074s 2026-02-13T03:52:10.646 INFO:tasks.cephadm:Archiving logs... 2026-02-13T03:52:10.647 DEBUG:teuthology.misc:Transferring archived files from trial070:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108/remote/trial070/log 2026-02-13T03:52:10.648 DEBUG:teuthology.orchestra.run.trial070:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T03:52:10.875 DEBUG:teuthology.misc:Transferring archived files from trial127:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108/remote/trial127/log 2026-02-13T03:52:10.876 DEBUG:teuthology.orchestra.run.trial127:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T03:52:10.983 DEBUG:teuthology.misc:Transferring archived files from trial177:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108/remote/trial177/log 2026-02-13T03:52:10.984 DEBUG:teuthology.orchestra.run.trial177:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T03:52:11.083 INFO:tasks.cephadm:Removing cluster... 2026-02-13T03:52:11.083 DEBUG:teuthology.orchestra.run.trial070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 --force 2026-02-13T03:52:11.201 INFO:teuthology.orchestra.run.trial070.stdout:Deleting cluster with fsid: 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:52:11.360 DEBUG:teuthology.orchestra.run.trial127:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 --force 2026-02-13T03:52:11.481 INFO:teuthology.orchestra.run.trial127.stdout:Deleting cluster with fsid: 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:52:11.640 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0c5cf8b4-088e-11f1-b830-d404e6e7d460 --force 2026-02-13T03:52:11.760 INFO:teuthology.orchestra.run.trial177.stdout:Deleting cluster with fsid: 0c5cf8b4-088e-11f1-b830-d404e6e7d460 2026-02-13T03:52:11.920 INFO:tasks.cephadm:Removing cephadm ... 2026-02-13T03:52:11.920 DEBUG:teuthology.orchestra.run.trial070:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T03:52:11.938 DEBUG:teuthology.orchestra.run.trial127:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T03:52:11.957 DEBUG:teuthology.orchestra.run.trial177:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T03:52:11.973 INFO:tasks.cephadm:Teardown complete 2026-02-13T03:52:11.974 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T03:52:11.976 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-13T03:52:11.992 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T03:52:12.007 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T03:52:12.007 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T03:52:12.010 DEBUG:teuthology.orchestra.run.trial127:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T03:52:12.012 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T03:52:12.253 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T03:52:12.265 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T03:52:12.265 DEBUG:teuthology.orchestra.run.trial070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:52:12.267 DEBUG:teuthology.orchestra.run.trial127:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:52:12.269 DEBUG:teuthology.orchestra.run.trial177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:52:12.281 INFO:teuthology.orchestra.run.trial070.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:52:12.284 INFO:teuthology.orchestra.run.trial127.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:52:12.284 INFO:teuthology.orchestra.run.trial177.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:52:12.303 INFO:teuthology.orchestra.run.trial127.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:52:12.303 INFO:teuthology.orchestra.run.trial127.stdout:=============================================================================== 2026-02-13T03:52:12.303 INFO:teuthology.orchestra.run.trial127.stdout:^* time.cloudflare.com 3 6 377 51 +77us[ +135us] +/- 6563us 2026-02-13T03:52:12.303 INFO:teuthology.orchestra.run.trial127.stdout:^- x.ns.gin.ntt.net 2 6 377 52 +136us[ +195us] +/- 70ms 2026-02-13T03:52:12.303 INFO:teuthology.orchestra.run.trial127.stdout:^- ntp1.wiktel.com 1 6 377 51 -1615us[-1615us] +/- 21ms 2026-02-13T03:52:12.303 INFO:teuthology.orchestra.run.trial127.stdout:^- arm1.maxhost.io 2 6 333 51 +135us[ +135us] +/- 55ms 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial070.stdout:=============================================================================== 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial070.stdout:^* time.cloudflare.com 3 6 377 53 +63us[ +86us] +/- 6823us 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial070.stdout:^- x.ns.gin.ntt.net 2 6 377 51 +184us[ +184us] +/- 70ms 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial070.stdout:^- ntp1.wiktel.com 1 6 377 51 -1515us[-1515us] +/- 21ms 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial070.stdout:^- arm1.maxhost.io 2 6 317 50 -282us[ -282us] +/- 55ms 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial177.stdout:=============================================================================== 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial177.stdout:^+ s2-a.time.mci1.us.rozint> 2 6 377 51 +1180us[+1180us] +/- 23ms 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial177.stdout:^- x.ns.gin.ntt.net 2 6 377 54 +337us[ +326us] +/- 70ms 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial177.stdout:^* ntp1.wiktel.com 1 6 377 53 -1008us[-1019us] +/- 20ms 2026-02-13T03:52:12.304 INFO:teuthology.orchestra.run.trial177.stdout:^+ arm1.maxhost.io 2 6 377 52 +339us[ +339us] +/- 54ms 2026-02-13T03:52:12.305 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T03:52:12.317 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T03:52:12.317 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T03:52:12.331 DEBUG:teuthology.orchestra.run.trial070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T03:52:12.393 DEBUG:teuthology.orchestra.run.trial127:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T03:52:12.439 DEBUG:teuthology.orchestra.run.trial177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T03:52:12.488 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:52:12.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:52:12.516 DEBUG:teuthology.orchestra.run.trial127:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:52:12.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:52:12.543 DEBUG:teuthology.orchestra.run.trial177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:52:12.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:52:12.572 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T03:52:12.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T03:52:12.602 INFO:teuthology.task.internal:Duration was 732.188566 seconds 2026-02-13T03:52:12.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T03:52:12.617 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T03:52:12.618 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T03:52:12.621 DEBUG:teuthology.orchestra.run.trial127:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T03:52:12.625 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T03:52:12.655 INFO:teuthology.orchestra.run.trial070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:52:12.659 INFO:teuthology.orchestra.run.trial127.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:52:12.661 INFO:teuthology.orchestra.run.trial177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:52:13.084 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T03:52:13.084 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial070.front.sepia.ceph.com 2026-02-13T03:52:13.085 DEBUG:teuthology.orchestra.run.trial070:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T03:52:13.142 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial127.front.sepia.ceph.com 2026-02-13T03:52:13.143 DEBUG:teuthology.orchestra.run.trial127:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T03:52:13.163 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial177.front.sepia.ceph.com 2026-02-13T03:52:13.164 DEBUG:teuthology.orchestra.run.trial177:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T03:52:13.183 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T03:52:13.183 DEBUG:teuthology.orchestra.run.trial070:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:52:13.185 DEBUG:teuthology.orchestra.run.trial127:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:52:13.206 DEBUG:teuthology.orchestra.run.trial177:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:52:13.430 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T03:52:13.431 DEBUG:teuthology.orchestra.run.trial070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:52:13.433 DEBUG:teuthology.orchestra.run.trial127:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:52:13.435 DEBUG:teuthology.orchestra.run.trial177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T03:52:13.453 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:52:13.455 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:52:13.455 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T03:52:13.455 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:52:13.455 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T03:52:13.457 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:52:13.458 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:52:13.458 INFO:teuthology.orchestra.run.trial127.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T03:52:13.459 INFO:teuthology.orchestra.run.trial127.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:52:13.459 INFO:teuthology.orchestra.run.trial127.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T03:52:13.459 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:52:13.460 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:52:13.460 INFO:teuthology.orchestra.run.trial177.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T03:52:13.461 INFO:teuthology.orchestra.run.trial177.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T03:52:13.461 INFO:teuthology.orchestra.run.trial177.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T03:52:13.471 INFO:teuthology.orchestra.run.trial127.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T03:52:13.474 INFO:teuthology.orchestra.run.trial177.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T03:52:13.500 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 92.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T03:52:13.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T03:52:13.515 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T03:52:13.515 DEBUG:teuthology.orchestra.run.trial070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T03:52:13.566 DEBUG:teuthology.orchestra.run.trial127:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T03:52:13.590 DEBUG:teuthology.orchestra.run.trial177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T03:52:13.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T03:52:13.637 DEBUG:teuthology.orchestra.run.trial070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:52:13.639 DEBUG:teuthology.orchestra.run.trial127:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:52:13.642 DEBUG:teuthology.orchestra.run.trial177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:52:13.661 INFO:teuthology.orchestra.run.trial070.stdout:kernel.core_pattern = core 2026-02-13T03:52:13.665 INFO:teuthology.orchestra.run.trial127.stdout:kernel.core_pattern = core 2026-02-13T03:52:13.681 INFO:teuthology.orchestra.run.trial177.stdout:kernel.core_pattern = core 2026-02-13T03:52:13.700 DEBUG:teuthology.orchestra.run.trial070:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:52:13.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:52:13.740 DEBUG:teuthology.orchestra.run.trial127:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:52:13.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:52:13.756 DEBUG:teuthology.orchestra.run.trial177:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T03:52:13.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:52:13.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T03:52:13.795 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T03:52:13.796 DEBUG:teuthology.misc:Transferring archived files from trial070:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108/remote/trial070 2026-02-13T03:52:13.796 DEBUG:teuthology.orchestra.run.trial070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T03:52:13.835 DEBUG:teuthology.misc:Transferring archived files from trial127:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108/remote/trial127 2026-02-13T03:52:13.835 DEBUG:teuthology.orchestra.run.trial127:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T03:52:13.871 DEBUG:teuthology.misc:Transferring archived files from trial177:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48108/remote/trial177 2026-02-13T03:52:13.871 DEBUG:teuthology.orchestra.run.trial177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T03:52:13.908 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T03:52:13.908 DEBUG:teuthology.orchestra.run.trial070:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T03:52:13.911 DEBUG:teuthology.orchestra.run.trial127:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T03:52:13.914 DEBUG:teuthology.orchestra.run.trial177:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T03:52:13.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T03:52:13.973 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T03:52:13.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T03:52:13.990 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T03:52:13.990 DEBUG:teuthology.orchestra.run.trial070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T03:52:13.993 DEBUG:teuthology.orchestra.run.trial127:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T03:52:13.996 DEBUG:teuthology.orchestra.run.trial177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T03:52:14.006 INFO:teuthology.orchestra.run.trial070.stdout: 791883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 03:52 /home/ubuntu/cephtest 2026-02-13T03:52:14.011 INFO:teuthology.orchestra.run.trial127.stdout: 786857 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 03:52 /home/ubuntu/cephtest 2026-02-13T03:52:14.013 INFO:teuthology.orchestra.run.trial177.stdout: 791883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 03:52 /home/ubuntu/cephtest 2026-02-13T03:52:14.014 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T03:52:14.038 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T03:52:14.073 INFO:teuthology.run:Summary data: description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 732.1885657310486 failure_reason: '"2026-02-13T03:43:39.022574+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL)" in cluster log' flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T03:52:14.073 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T03:52:14.175 INFO:teuthology.run:FAIL